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ABSTRACT 

A prolect examined the effectiveness of the Youth 
Career Development (YC0) Demonstration in facilitating the 
schocl-to-work transition of hiah school seniors. The evaluation 
involved a 1755-student test group and a 168i|-student control group 
from 30 sites funded by six delivery agents (National Urban League, 
National Council of Negro Women, SER Jobs for Progress, the 
Recruitment and Training Program, the o. S. Employment Service, and 
the Women 1 s Bureau of the Department of Labor) • Approaches at these 
sites included activities to eliminate sex stereotyping; helping 
Hispanic, black, and other minority youth: use of instituional 
agencies to facilitate the school- to-work transition; and use of 
community- and neighborhood-based groups to accomplish the same task. 
Surveys to measure performance outcomes after a tLree-month followup 
period revealed that the school-to-work transition activities 
produced a statistically significant increase in abilities to find 
and hold 1obs. While postprogram outcomes at the three-month period 
are modest, significant gains, probably adequate to justify costs, 
are realized by certain of the delivery agents and certain subgroups 
of the target population. (Related youth knowledge and development 
reports are available separately--see note.) (MN) 
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OVERVIEW 



A large share of both graduates and dropouts leave school without 
adequate preparation for the world of work. Reading and 
computational deficits are significant and leave lasting scars. 
But many employers claim they could utilize youth, even those 
with limited academic skills, if they at least knew the rudiments 
of work force demands. There are a cluster of basic work skills 
which most youth acquire through exposure to family and friends, 
as well as periods of work experience part-time and during the 
summer. These skills include the ability to make career and 
job choices with some intelligence, to know where and how to 
look and apply for work, to be motivated and independent enough 
to enter the labor market and to understand the expectations of 
employers in regular jobs. 

Research has documented unequivocably that youth with more 
knowledge of careers, with self-assurance and motivation, as 
well as realistic understanding of the damands of the workplace, 
are more likely to hold jobs as teenagers as well to have greater 
labor market success as young adults. Research has documented 
that the gaps in such basic skills for minorities and the poor 
begin even before high school and have a cumulative, interactive 
impact by limiting the chances of successful work experience 
during the teen years. Evaluations have documented the limited 
assistance provided during the school years help develop basic 
skills. Student counseling and placement activities are v college 
oriented and spread too thinly; kilewise, cooperative education 
tends to serve the most advantaged youth who already have their 
career goals. 

There are a cluster of services which could be, although they 
too rarely are, offered to teenagers, with the school the logical 
setting because almost all youth are in school at least to age 16. 
These "school-to-work" transition activities include job-search 
assistance which teaches methods of job hunting, motivational 
activities to build self-esteem and confidence, occupational 
information and efforts to overcome sex-stereotyping, career 
exploration through classroom instruction, worksite visits, lectures, 
and rotational work assignments, placement assistance, work- 
related counseling and follow-up or* the job. These services, which 
go under many different names and have many different approaches, 
might be distinguished from in-school work experience which can 
also be transit ional in intent and may be combined with transition 
services. 

There are also a number of potential delivery agents for such 
activities. Within the schools, guidance counselors, cooperative 
and vocational education personnel, could all offer such services 
if they had adequate resources. Private employers in a few 
isolated cases have "adopted" schools; labor unions and apprentice- 
ship systems can do the same. The Employment Service at one time 
had placement personnel that worked at least part time in a 
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majority of the high schools in the country. Community and 
neighborhood groups and voluntary youth serving agencies are 
another alternative. 

Finally, there are a number of different potential target 
groups for scarce services. Emphasis might be placed on 
young women to help them overcome sex stereotyping or on the 
disadvantaged and minorities to overcome the effects of 
discrimination and poverty. Alternatively, all youth in need 
of services mifht be reached by spreading resources more thinly. 
A fundamental issue is then the targeting and intensity of 
services. 

The Youth Employment and Demonstration Projects Act of 1977 
mandated the expansion of school-to-work transition services, 
making all youth eligible, and requiring that every work 
experience in-school be combined with counseling, occupational 
information, placement assistance and efforts to overcome sex 
stereotyping, while requiring that 22 percent of funds under 
Youth Employment and Training Programs be set aside for such 
services to in-school youth. However, YEDPA also mandated 
tests of the effectiveness of such services. The unfortunate 
truth is that we know very little about the impacts of these 
activities, the effectiveness of alternate delivery agents 
or the most appropriate target groups. Generally, these services 
on low cost and can be expected to have only a modest measurable 
effect. Because the tools to measure impacts are crude and 
because few careful experiments have been undertaken, effective- 
ness has not been documented. 

Under YEDPA 1 s discretionary authority there have been a number 
of tests to better measure the impact of transition services. 
There are multi-site experiments with job search assistance 
and vocational exploration. Statewide private nonprofit 
organizations have been established to offer a "non bureaucratic" 
approach to the delivery of services. There has been a test of 
saturation of transition services in a controlled and experimental 
high school. Apprenticeship in-school programs have been initiated 
in multiple sites. School -to-work transition programs have been 
developed through a competitively funded demonstration project 
involving CETA/school cooperation. Finally, structured experiments 
have been undertaken in multiple sites utilizing community and 
neighborhood groups and the Employment Service as delivery agents. 
Under all these demonstrations, careful research designs have 
been implemented to measure the impacts of services. 

This report presents the preliminary findings from the Youth Career 
Development demonstration which seeks to measure the impact of 
school-to-work transition services as developed and implemented 
by six separate clusters of delivery agents in a total of 30 sites 
in the country, in Each site, a control and experimental group 
were tested upon entry into the program at the start of their 
senior year, upon completion of the program, and three months 
beyond the close of the academic year utilizing the instruments 
in the Standardized Assessment System which has been developed 
for YEOPA demonstration projects. The experimental groups consisted 
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of 1755 students and the control group 1684, 

The six delivery agents for these projects varied in focus and 
approach. The sites operated under the direction of the 
National Council on Negro Women and the Women's Bureau stressed 
activities to help overcome sex stereotyping; the projects 
focused on a female target group. The sites operated by SER Jobs 
for Progress concentrated on Hispanic youth, while the National 
Urban League and the Recruitment and Training Program focused 
on minority, mostly black populations, including both males and 
females. The U.S. Employment Service represents the "institutionol" 
approach in contrast to the other delivery agents which are 
community and neighborhood based groups. Generally, however, 
these sponsors operated within the same budgets and general 
parameters at the local level. 

The findings reported in this analysis are extremely tentative. 
They apply to the first cohort of youth through projects which 
were, in some cases, established during the course of the school 
year with all the attendant implementation difficulties. The 
treatment group could, at most, get one school year of services 
compared with future cohorts in YCD who enter as juniors and 
may get two years of treatment. 

The 3 month follow-up period comes immediately after the end of 
the summer before many of the youth will have settled down. 
An eight month follow-up is scheduled which will pick up the 
longer-term impacts. Finally, the analysis undertaken in this 
report represents only a small portion of that planned for the 
YCD. The analysis was prepared to get an initial sense of the 
results. 

With these caveats, the preliminary findings might be summarized 
as follows: 



1. There is evidence that the school-to-work transition 
activities produce a statistically significant increase in 
abilities to find and hold jobs. The Standardized Assessment 
System includes a battery of pre-/post psychometric measures. 
Experimentals gained relative to controls on vocational attitudes, 
job holding skills, work related attitudes, job seeking skills, 
job knowledge and in overcoming sex stereotypes about jobs. 
Only on the self-esteem measure did there seem to be no positive 
impact from participation. 



2. The measured levels and gains on the psychometric 
instruments are statistically correlated with successful 
participation in the projects and positive outcomes at the three 
month follow-up point. Even though the measures are crude, they 
apparently discern real and important changes. 

3. The post-program outcomes at the three-month point are 
modest. For every hundred entrants, 2 more of the experimentals 
than the controls are employed full-time, 2 more are employed in 
skilled or semi-skilled jobs, 4 more aspire to skilled jobs and 
1 more is in-school or working. The outcomes are adjusted 
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for initial differentials. Although the differences are 
statistically significant it is questionable whether such gains 
would justify the outlays from a benefit-cost perspective. 
It remains to be seen whether the impacts will be greater at the 
eight month follow-up or whether they will be more significant 
once the projects have stabilized. 

4. Significant gains, probably adequate to justify costs, 
are realized by certain of the delivery agents and certain 
subgroups of the target population. This suggests that with 
proper delivery and targeting transition services might prove 
an effective strategy. 

This volume is one of the products of the "knowledge development" 
effort implemented under the mandate of the Youth Employment and 
Demonstration Projects Act of 1977. The knowledge development 
effort consists of hundreds of separate research, evaluation and 
demonstration activities which will result in literally thousands 
of written products. The activities have been structured from the 
outset so that each is self-standing but also interrelated with a 
host of other activities. The framework is presented xii A Knowledg e 
Development Plan for the Youth Employment and Demonstration Projects 
Act of 1977 , A Knowledge Development Plan for the Youth Initiatives 
Fiscal 1979 and Completing the Youth Agenda; A P la n for Knowledge 
Development, a nfl Di^^ai^nati^n 1 an d: Appltoatefrwi' £ ov- friS^l i saa, 

Information is available or will be coming available from these 
various knowledge development efforts to help resolve an almost 
limitless aray of issues. However , policy and practical application 
will usually require integration and synthesis from multiple 
products , which , in turn, depends on knowledge and availability of 
these products. A major shortcoming of past research, evaluation 
and demonstration activities has been the failure to organize and 
disseminate the products adequately to assure the full exploitation 
of the findings. The magnitude and structure of the youth knowledge 
development effort puts a premium on structured analysis and wide 
dissemination. 

As part of its knowledge development mandate, therefore, the 
Office of Youth Programs of the Department of Labor will organize, 
publish and disseminate the written products of all major research, 
evaluation and demonstration activities supported directly by or 
mounted in conjunction with OYP knowledge development efforts. 
Some of the same products may also be published and disseminated 
through other channels , but they will be included in the structured 
series of Youth Knowledge Development Report s in order to facilitate 
access and integration. "* 

The Youth Knowledge Development Reports , of which this is one, 
are divided into ±veiye hpoad categopye^; 



1. Knowledge Development Framework : The products in this category 
are concerned with the structure of knowledge development activities, the 
assessment methodologies which are employed, the measurement instruments 
and thei^ validation, the translation of knowledge into policy, and the 
strategy for dissemination of findings. 

2. Research on Youth Employment and Employabil i ty Development : The 
products in this category represent analyses of existing data, presentation 
of findings from new data sources, special studies of dimensions of youth 
labor market problems, and policy issue assessments. 

3 . Program Evaluations : The products in thi s category i ncl ude 
impact, process and benefit-cost evaluations of youth programs including 
the Summer Youth Employment Program, Job Corps, the Young Adult Con- 
servation Corps, Youth Employment and Training Programs, Youth Community 
Conservation and Improvement Projects, and the Targeted Jobs Tax Credit. 

4. Service and Participant Mix : The evaluations and demonstrations 
summarized in this category concern the matching of different types of 
youth with different service combinations. This involves experiments with 
work vs. work plus remediation vs. straight remediation as treatment 
options. It also includes attempts to mix disadvantaged and more affluent 
participants, as well as youth with older workers. 

5. Education and Training Approaches : The products in this category 
present the findings of structured experiments to test the impact and 
effectiveness of various education and vocational training approaches 
including specific education methodologies for the disadvantaged, al- 
ternative education approaches and advanced career training. 

6. Pre-Employment and Transition Services : The products in this 
category present the findings of structured experiments to test the impact 
and effectiveness of school -.o-work transition activities, vocational 
exploration, job-search assistance and other efforts to better prepare 
youth for labor market success. 

7. Youth Work Experience : The products in this category address the 
organization of work activities, their output, productive roles for youth, 
and the impacts of various employment approaches. 

8. Implementation Issues : This category includes cross-cutting 
analyses of the practical lessons concerning "how- to-do-it." Issues such 
as learning curves, replication processes and programmatic "batting 
averages" will be addressed under this category, as well as the comparative 
advantages of alternative delivery agents. 

9 . Design and Organizational Alternatives : The products in thi s 
category represent assessments of demonstrations of alternative program and 
delivery arrangements such as consolidation, year-round preparation for 
summer programs, the use of incentives, and multi-year tracking of 
individuals. 



10. Special Needs Groups : The products in this category present 
findings on the special problems of and the programmatic adaptations needed 
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£.rfh Slg fliH?!* st3 "L ents deluding minorities, young mothers, troubled 
youth, Indochinese refugees, and the handicapped. 

11- Innovative Approaches; The products in this category present the 
findings of those activities designed to explore new approaches The 

ShJS? C( T ed - 1 -1 C U * de the Youth Incentive Entitlement Pilot Projects? 
private sector initiatives, the national youth service experiment and 
energy initiatives in weatherization, low-head hydroelectric JT ™tE 
ration, windpower, and the like. 

}2- Instituti on al Linkages : The products in this category include 
studies of institutional arrangements and linkages as well as assessments 
of demonstration activities to encourage such linkages wit,, education? 
volunteer groups, drug abuse, and other youth serving agencies. ULat,on » 

nannJV,?- 0 " °! t J' eSe know l ed ge development categories, there will be a 
on SJfSl £5 Cre i t ? dem °nstration research and evaluation activities focused 
on different po icy, program and analytical issues, m turn, each discrete 

idd!!l«S1 Jo Ve l-?f nt . Pr 2^' ect - may nave a series of «• nS„ proSuctl 
addressed to different dimensions of t.h e issue. For instance all 

experimental demonstration projects have both process and Impact 'eval- 
uations, frequently undertaken by different evaluation agents P Finings 
will be published as they become available so that there will usually be a 
series of reports as evidence accumulates. To organize these products 
each publication is classified in one of the twelve broad Kedge 
development categories, described in terms of the more specific ?'sul, 
activ ty or cluster of activities to which it is addressed with an 

J en tV/ ,e dL°oL t , ne ^ r0dUCt u and wnat 14 presents relative to other produc?" 
in the demonstrations. Hence, the multiple products under a knowledge 
development activity are closely interrelated and the actlvltas T el 
broad cluster have significant interconnections. 

aC c 0 cI5j S . initia l. re P° rt on . the Youth Career Development program should be 
assessed in conjunction with School -to-Work Transition S ervices-"process 
Analysis of the Youth Career Deve lopment Program wh,rh p?£fL .^1 
insights into the statistical results in this volume. School -to-Work 
Transition Services-The F^nTrv m-School Proiectnpmnn^t r^V^Bl!? 
FTess statistically oriented analysis of very similar projects lau nched as 

S ^ 1V %lT°of tS th b p etWeen H l 00 ' 1 - ed , UCat „ ion ^encie's'and CETA Sl-e* 
sponsors. All of the products in the "pre-employment and transition 
services" category are related but particular! y Vocational I Exp! o rSt on-" 

inpriln^l 1 ," 95 l" d Back T"nd, and Job Sear ch Assistance-.sSrvey -Tnd 
txperimental Rejuits. The methodologies and instruments applied in this 
a ^' y i S1 5 'J 6 , descr1bed m The Standardized Assessment System n the 

knowledge development framewor k" category. Finally, evaluation H Iterators 
is summarized in Between Two Worlds- ^ Trinil&'n^S School I to^r-rk 
and Employment ano Training Pro grams for Youth-What~WoTkTBest For uhnm? 
in the researcn on youth employment employabi l ity development" category . 

Robert Taggart 

Administrator 

Office of Youth Programs 
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introduction 

This paper presents an initial examination of findings regarding the 
extent to which the Youth Career Development (YCD) has influenced the 
performance of high school seniors enrolled during the 1978-79 acadanic year. 

Six delivery agents been responsible for the conduct of that 
YEDPA funded program: the '^.clonal Urban League, the National Council of 
Negro Women, SER Jobs for Progress, the Recruitment and Training Program, 
the Women's Bureau of the Department of Labor and the U.S. Bnployment Service. 
These agents had oversight and funding responsibility for a total of 30 
sites throughout the country and for the collection of all data on which the 
evaluation study is based. Those data were obtained from YCD program 
parxicipants and control group students on a longitudinal basis? beginning 
at the time of initial enrollment early in the high school senior year, 
again at the time of completion of high school (i.e., nominal completion 
of the p rogram) and continuing for approximately three months beyond the close 
of the acadanic year. 

Instruments used by the delivery agents for gathering the data 
utilized in the present analyses are contained in a Standardized Assessment 
System (SAS) devised for the U.S. Department of Labor ! s Office of Youth 
Programs and intended for use as a cannon "core 11 of assessment tools 
in evaluations of a variety denbnstraticn program funded under YEDPA. A 
technical report has described the background and rationale for the choice 
of these instruments (The Standardized Assessment System, April 1980) that 
consists of: (a) a battery of seven vocationally-oriented scales used for pre 
and posttest gain score assessment over the course of program participation, 
designated as the psychometric battery; (b) two survey instruments, one 
used to measure performance outcomes (i.e., degree of "successful 11 
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adjustment by participants) at program completion (Program Completion 
Survey), and the other measuring successes achieved at periods of 3 and 8 
months following program completion (Follow-up Survey); (c) two instruments 
for measurement of participant characteristics— a short (20 item) 
wide-range measure of reading ability (STEP Reading Test) and a 49 item 
form containing largely demographic or status information about the 
participant at the time of program entry and at completion of the training 
program (The Individual Participant Profile). 

Study Design 

Measures of the SAS were applied for data gathering purposes to 
YCD participants and (where applicable) to comparable control groups 
of students from the same school systems as the participants. The 
overall design for an in-school program is summarized in Appendix 0. 
Follow-up data used for the analyses presented here extend to the 
3 month follow-up period. 

Description of the Sample 

The samples on which the present analyses are based consist of 1755 
YCD high school senior participants and 1684 control group students who 
were pretested during the 1978-79 academic year. The total participant 
sample was composed of 37% males and 61% females of whom 62% were 
classified as Black, 20% Hispanic, 15% white, and 2% of other ethnic 
group mcmberHhlp (e.g., Asian, American Indian).* In terms of economic 
status, the largest proportion of the sample (49%) fell into the 70% 



Where totals for the categories of any variable do not add up to 100%. 
The discrepancies are based upon no response (blank) on the IPP form. 
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lower living standard income level (LLSIL) or lower, while the next 
largest proportion (23%) were classified as in the 71-85% LLSIL. 
Seventy-three percent (73%) of the participants were also classified 
as economically disadvantaged at the time of program entry • 
(See Table 1-A.) 

In terms of previous jobs or job training for these students, 31% 
were reported to have been CETA participants prior to program entry and 
62% to have held some form of employment • Of the group reporting prior 
employment, most of them (about 60%) had held jobs at the lower status 
occupational levels (e.g., low level service and operative level); as 
might be expected for a sample of high school seniors, economically 
disadvantaged or not. Their hourly wages were predominantly in the 
$2.50 to $3.00 an hour minimum wage range. Interestingly, a large 
proportion of these jobo held (about 74%) were reported as not based on 
payment of a subsidized wage. 

A major proportion of the sample who were pretested, and for whom 
IPP information was supplied, are reported to have remained enrolled for 
60 hours or longer (i.e., approximately three-fourths of this sample). 
Distributions of some of the key variables discussed above for the total 
participant sample are presented in Table 2 for each service delivery agent. 

Of the 1755 senior participants pretested, 59% were able to be 
posttested and 47% of the original sample were able to be located (who 
would also respond to the Program Follow-up Survey) three months after 
completion of the academic year.* Among the 833 participants followed-up 



Appendices A through G provide sample sizes for a flow-through of 
instrument administration by participants and controls within delivery 
agent for all possible combinations of the 4 measures (IPP, Pretest, 
Pr jttest and three-month follow-up survey). 



over a 3-month post-high school period, 24% indicated that they had 
obtained employment on a full-time basis and 34% indicated that they 
hold, or had held, part-time employment. Enrollment in some form of 
formal training was reported by 56% of these former participants, with 
78% of that group engaged in such training on a part-time basis. The . 
dominant educational or training settings in which these students were 
found (full-time or part-time) were college (65%) and post-secondary 
business or vocstional/technical schools (10%). 

Description of the Control Group 

The total control group ssmple was composed of 38% msles snd 
61% femsles of whom 57% were clsssified as Blsck, 21% Hispsnic, 18% 
White, snd 4% of other ethnic group membership. In terms of economic 
ststus, the lsrgest populstion of the control group (41%^ fell into 
the 70% lower living stsndsrd income level (LLSIL) or lower, while the 
next lsrgest populstion (16%) were clsssified as in the 71-85% LLSIL. 
Thirteen percent (13%) of the controls were in the 86% or grester 
LLSIL cstegory. Fifty-nine percent (59%) of the controls were slso 
classfied as econoraicslly dissdvsntsged st the time of progrsm entry. 
(See Tsble 1-B). 

Regsrding previous Jobs or Job trsining, 21% of the controls 
reported to hsve been CETA psrticipsnts prior to program entry and 58% 
to hsve held some form of employment. 

Of the 1684 controls pretested, 59% were posttested, snd 38% were 
followed-up three months later. 
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TABLE 1-A 

Summary of Participant Sample Composition by Service Delivery Agent 

(In Percentages) 

WOMEN'S 

Variable USES NUL SER BUREAU NCNW RTP TOTAL 

Sex; 



M 


40 


50 


41 


00 


42 


40 


37 


F 


60 


46 


57 


99 


56 


59 


61 


Blank 


0 


4 


2 


1 


2 


1 


2 


Race; 
















Black 


63 


78 


5 


67 


66 


85 


62 


White 


20 


19 


2 


27 


8 


12 


15 


Hispanic 


13 


2 


92 


00 


23 


0 


20 


Other (or not 
reported) 


4 


1 


1 


6 


3 


3 


3 


Economic Status: 
















702 LLSIL 


48 


63 


31 


85 


12 


45 


49 


71-85* LLSIL 


33 


6 


46 


11 


41 


14 


23 


86% or more 


6 


5 


7 


1 


12 


24 


9 


Blank 


13 


26 


16 


3 


35 


17 


19 


Employment Prior 
to YCD: 
















(Part-time or 
Full-time) 

Blank 


73 
26 


70 
30 


66 
34 


45 
55 


48 

52 


54 
46 


62 
38 


Previous CETA 
Participation: 
















Yes 


40 


34 


30 


27 


29 


22 


31 


No 


44 


61 


68 


69 


63 


74 


63 


Blank 


16 


5 


2 


4 


8 


4 


6 
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TABLE 1-B 

Summary of Control Sample Composition by Service Deliver/ Agent 

(In Percentages)* 



Variable 




MITT 


CCD 


WOMEN'S 
BUREAU 


NCNW 


RTP 


T0TA1 


Sex: 
















M 


41 


47 




0 


v 




38 


F 


59 


51 


54 


QQ 


0 J 


c o 
58 


61 


Blank 


0 


2 


2 


l 


1 


1 


1 


Race: 
















Black 


57 


83 


5 


27 


70 


72 


57 


White 


27 


16 


3 


71 


22 


19 


18 


Hispanic 


12 


1 


89 


0 


4 


2 


21 


Other (or not 
















reported) 


4 


0 


3 


2 


A 


7 


/, 
H 


Economic Status: 
















70% LLSIL 


53 


70 


22 


61 


2 


45 


41 


71-85% LLSIL 


18 


2 


29 


8 


8 


18 


16 


86Z or mo rp 


j 


1 

X 


1 O 

18 


22 


2 


25 


13 


Blank 


24 


27 


31 


9 


88 


12 


30 


Employment Prior 
to YCD: 
















(Part-time or 
Full-time) 


75 


67 


57 






An 


58 


Blank 




JJ 


A 1 

43 


55 


54 


51 


42 


Previous CETA 
















Particlnntion: 
















Yes 


40 


26 


15 


11 


24 


7 


21 


No 


47 


59 


74 


79 


55 


89 


67 


Blank 


13 


15 


11 


10 


21 


4 


12 
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Efrta Analyses 

The initial analysis of the YCD data is to cover only a portion of 
the more extensive analysis plan for YEDPA programs (The Standardized 
Assessment System, April ] 980) . Three analytical phases of that plan are 
undertaken here, in a limited way: 

(1) Gain Score Analyses - of the SAS psychometric scales, to define 
the extent to Which the progr am effected change in the behavioral constructs 
measured. This is based on contrasts between participant and control 
group performance for the total YCD sample and for pooled data from the 
project sites of each of the six delivery agents conducting YCD programs. 
An analysis of covariance design (ANOOVA) represents the primary approach 
to the analysis, with matching or equating variables consisting of level 
of reading ability and selected danographic characteristics drawn from the 
IPP. 

2) Identification of those tests measures which show relationships 
betwtxai outcome variables and gain from pre and post - Program related 
gains in test scores are relatively meaningless unless these gains can be 
shown in turn to be related to subsequent labor market status. This 
analysis addresses the question of which attitudlnal and knowledge gains 
are important for future labor market performances. The four selected labor 
market related performances are (1) being employed full-time, (2) 
being employed In a skilled or semi-skilled job rather than an unskilled 
job, (3) aspiring to a skilled or semi-skilled job rather than an unskilled 
job and (4) relative involvement in a positive activity status, e.g., working 
full-time, going to school full-time, etc. It is anticipated that the 
results of this analysis will provide: (1) further validity information 
on the psychometric battery, and (2) policy Information regarding 



which attitudinal and knowledge areas should receive high priority when 
time and talent are being allocated within those YCD programs. 

(3) Identification of subgroups or types of participants who 
showed the greatest and least test score g ins - in an attempt to define 
the differentiating characteristics of those who were most significantly 
affected by the program when contrasted with those affected the least, 
(i.e., Is there a pattern of background or status variables that differen- 
tiates those who gain the most from YCD from those who gain the least?). 

(4) Contrasts between participants and control group students 
delivery agents on criteri on performance measures - three months 

following high school completion, in order to determine the extent of 
program impact on vocational and social adjustments. This is based on 
adjusted mean comparisons between participant and control groups for key 
outcome variables. As is in gain score analysis, the adjusted means on 
the 3-month follow-up are corrected for possible pre-existing group 
differences in demographic variables. In an effort to provide results in 
a more interpretable format for thr. policy decision maker, selected 
outcomes are presented . possible both in terms of mean differences 
as well as probabilities of particular desired events occuring. 
PsYchcr^ric Score Analysis 

Interprets ion 

The analysis of gain scores is concerned with participant and 
control group comparison with respect to test score gains. Three 
analytical methods will be used to compare the gains made by the treat- 
ment and control groups. The first mothod is the analysis of covariance 
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(ANODVA) which compares postest means, controlling for or adjusting 
for preexisting differences among the groups on pretest scores and 
demographic infonration. The variables from the IPP which were controlled 
in the ANOOVA approach were: (1) STEP Reading Test, (2) Sex, (3) Ifeunily 
Income level, (4) /dvarfcaged/^sadvantaged, (5) Ethnic group membership, 
(6) Whether or not previously employed, (7) Wage per hour. The second 
method far estimating differential group gain is the analysis of variance 
of difference scares (ANOVA) . The ANOVA approach mates only an adjustment 
far pre-existing group differences on the pretest score. The third 
method is known as standardized gain score analysis. The adjustments based 
on this method attempt to correct for possible differential grcup growth 
rates anVor preexisting demographic group differences. Although presentation 
of the results of all three analytical approaches represents an eclectic approach, 
we will emphasize the analysis of covariance (ANCCVA) results in our interpretation, 
since it has a stronger statistical basis than the other two methods. 

It is possible that "dropouts" in the treatment group may systematically 
differ from "dropouts " in the control population. For example, tne more 
employable individual may may be more likely to leave the p rogr am yielding a 
"negatively" selected participant sample with all the measures, m order to 
partially control for this, a dunny code was applied to all individuals in 
both the participant and control populations. Individuals were scored "1" if 
they had information on their IPP, pre and posttest scores and 3-month follow-up 
and those with just an IPP and 3-month follow-up were coded "0". The latter 
group would include a number of pr o gr a m dropouts. This "durrmy" score was 
used in the ANOCWA as control variable along with the other demographics. 
As before, these ANCOVA's were run for delivery agents as well as for totals. 
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Appendix X presents the cjvariance adjusted effects, inspection of these 
results are quite similar to those fourtf in the "uncorrected" ANCOVAS 
presented in Appendices H-N. An additional analysis which can and should 
be done for a final report would be to run the so-called "Belson" ANCDVA 
model to see if there might be some interactions between progr a m participation 
and demographics which haven't surfaced in either the above ANCOVAS or the 
participant-control comparisons by subgroups which have been run. 

Another possible source of bias which has yet to be evaluated is the 
larger number of "non-responses" to the 3-month follow-up questions which were 
involved in the four criteria areas. Since we are making participant -control 
group comparisons, we have to assume that the non-respondents in the two 
groups have similar characteristics. Fortunately, this is a much weaker 
assumption than having to as sine that the non-respondents have the same 
distributional characteristics as the respondents. Additional investigations 
of this possible source of bias would appear to be warranted. 

For ease of comparison across measures and program sites, the ANCOVA 
results are presented as differences between adjusted posttest means, for 
participant and control groups, in terms of standard deviations. The 
term "adjusted posttest means" refers to estimates of the participant and control 
group posttest means, controlling for preexisting mean differences on the 
pretest as well as differences in demographic characteristics of the two groups. 
If there were truly random assignment and no systematic "drop out" pattern, 
the ANCOVA test of group differences on the adjusted posttest means would be 
approximately the same as a simple "t" test of the unadjusted posttest means. 
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The differences between adjusted posttest means are presented in 
terras of standard deviation units because it makes comparisono between 
gains on instruments having different numbers of items more interpretable. 
Without such standardization, a one item gain in favor of the participant 
group over the control on a ten item test is not, in general, the same 
as a one item gain on a forty item test. In the first case the gain 
may represent 20% of a standard deviation, while in the second case 
it may only represent 5% of a standard deviation* 

Tables 2 through 8 present summary statistics for participant-control 
group comparisons from the ANCOVA. The reader will note that the first 
four columns present the pretest and posttest means and standard deviations 
for the participants. Column five is the participant adjusted posttest 
mean, for which the adjustment has been carried out by the analysis of 
covariance procedures. The difference between the participant adjusted 
posttest mean (Column 5) and the control group adjusted mean (Column 10), 
divided by the pooled standard deviation, yields the covnriance adjusted 
effect in Column 11. Thus the first number in Column 11 ;f Table 2 is 
.142, indicating that the participants gained approximat ily 14% of a 
standard deviation more than the control group on the Vocational Attitudes 
Scale. Indication of whether this gain is statistically significant is 
shown by a "T" value in Column 15* The asterisked "T" values indicate 
that the gain Is significant at the .05 level of statistical significance 
or greater. It should be kept in mind that statistical significance does 
depend on Hnmplo nlssi? nml IT the snmplp Ifl sufficiently large, we will 
almost always reject the null hypothesis of no differential group 
gain. Therefore, gains in favor of the participant group (or control 
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group) of at least 10% of a standard deviation will be interpreted as 
being small but of some practical signif icance. 

A negative sign accompanying the adjusted gain in Column 11 would 
indicate that the control group gained more than the participant group. 
The sign (positive or negative) in Column 11 indicates which group gained 
and the accompanying number indicates how much the gain is in terras of 
percentages of standard deviations. 

Column 12, entitled "raw in", is an estimate of group gain based 
on the repeated measures design and is equivalent to the analysis of 
variance of difference scores. This estimate mav differ somewhat from 
the ANCOVA (Column 11) estimate since it does not directly control for 
demographic differences among the groups. As in the case of the ANCOVA, 
the differential gain is presented in terms of standard deviation 
units. Similar to the ANCOVA result, the first number in Column 12 of 
Table 2 (.125) has a positive sign, indicating that the participant 
group gained approximately 12-13% of a standard deviation more than the 
control group on the Vocational Attitude instrument. In general, the 
ANOVA result will be quite similar to the ANCOVA if the participants and 
controls are relatively well matched with respect to the demographic 
characteristics. 

Columns 13 and 14 are the results of standardized change score 
analysis and present partial correlations between group membership 
scores ("1" if participant, "0" if control) and pretest (Column 13) 
as well as posttest scores (Column 14). These partial correlations 
control for the same demographics a* were used in the analysis of 
covariance. If there is a gain in favor of the participant group, 



the pretest partial correlation in Column 13 should be less than the 
posttest partial correlation in Column 14. A negative sign accompanying 
the partial correlation in Column 13 indicates that when controlling for 
demographics, the control group member is likely to have a higher pretest 
score than the participant group member. 

A positive sign at posttest (i.e., following intervention) indicates 
that members of the participant group, on the average, have higher 
posttest scores than the controls, and therefore the participant group 
gained more than the controls. These two columns are only of interest if 
they yield different conclusions than the ANCOVA results. If that is the 
case, one might have to entertain the notion that the two groups may be 
growing at different rates with respect to the knowledge being measured 
in the absence of intervention. In addition, it would be difficult to 
estimate how much f>ain is due to program intervention and how much is due 
to gains that would tikz place in the absence of intervention. Comparisons 
of the covariance adjusted gain in Column 11 with the results of Column 
13 and 14 indicate, for the present data, that both methods generally 
lead to the same conclusions. 

Changes in participant test performance between the time of entry 
into the YCD program and program completion, based on the 7 psychometric meSasures 
are seen in Table 2 for the combined sample of participants over all YCD 
sites* The remaining 6 tables summarize the gain score results separately 
for each of the 6 delivery agents. 

From Table 2, the general conclusion regarding the effects of the 



-14- 



YCD Program for the entire sample is reasonably unequivocal. That is, 

wh*n the participant and control groups are contrasted with regard to 

their test score changes, with reading skill and demographic characteristics 

controlled, a decided improvement (gain) is found for the YCD participant 

group. The T tests in column 15 show that the effect is a statistically 

significant one for 5 of the 7 measures of the psychometric battery (Vocational 

Attitude, Job Holding Skills, Work Related Attitudes Inventory, Job 

Seeking Skills, and Sex Sterotyping of Atfult Occupations), with one of 

the measures (Job Knowledge) falling very slightly short of 

significance. Only one measure (Self Esteem) appears uninfluenced 

by program participation, 

Somewhat larger in their proportion of gain achieved— as seen from 
the covariance adjusted effect of Column 11— are the measures of Job 
Seeking Skills and Sex Sterotyping of Adul'. CV^Hon, with changes of 
17% and 24% of a standard deviate respectively between pragran entry 
and termination. It is also of interest to note tlut 3 of the 4 instruments 
on which the participant group gained i ore than 10% of a standard deviation 
over the control group are clearly attitudinal in content. 

This overall effectiveness found for the program is, unfortunately, 
not displayed uniformly across the six deliverv agents and their local 
projects. There are major differences in the degree of effectiveness 
achieved for those six subgroups of sites as seen in Tables 3 through 8. 
Examination of T tests (Column 15) and mean gains based on covariance 
adjustments (Column 11) reveals major gains by participants in 
contrast to controls for those enrolled in programs conducted by* 
(a) National Council of Negro Women (NCNW) - which appear in the 
form of positive (participant favored) gains for 6 

of the 7 measures, of which statistically significant gains were 
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produced for the Job Holding Skills, Job Seeking Skills and Sex Stereotyping 
measures, and (b) Recruitment and Training Program (RTP) with statistically 

significant and covariance adjusted effects on all 7 measures of the psychometric 
battery. 

A weaker tendency toward positive gain for participants is seen for 
the Urban League's program on a number of important measures. Although 
none quite reach a statistically significant level of change, there are 

small yet practical increases (10% of a standard deviation) in favor of 

4.he participants for Job Knowledge (10% of a standard deviation), Job 

Seeking Skills (12%), and Sex Sterotyping (12%). 

The three remaining delivery agents (Tables 6, 7, and 8) show very 

spotty and inconsistent changes when participants and control groups are 

compared. For the most part, there is no statistically significant 

change evidenced by these 3 sets of project sites and without exception, 

where a few instances of significant change do occur , they are found to 

be in an unfavorable direction such that program participants gain less 

than control group students. This can be seen as follows for: (a) U.S. 

Employment Service-which shows a significant decline (T - 2.20; p < .05) 

ir the participant adjusted mean for the Job Holding Skills measure in 

contrast to the control group adjusted mean, (b) Women's Bureau-with a 

highly significant decline on the Vocational Attitude Scale (i.e., some 

32% of a standard deviation drop) by participants in contrast to controls 

and a distinct tendency toward decline on 4 of the remaining 6 psychometric battery 

scales, (c) SER-Jobs For Progress-which shows a significant relative 

decline for participants on Self Esteem, while simultaneously showing a 

gain in the Vocational Attitude Scale that falls just short of significance 

(T ■ 1.93; p » .06) but has a marked increase in the proportion of a 

standard deviation gained (21% in its covariance adjusted effect). 
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TABLE 2 



ALL PROGRAMS COMBINED 



-"•''T:::a.',nTs 



917 



CP'ITPOLS 



864 



■EFFECTS 



_P?ET-ST 



WAN 
(1) 



S.3. 
12) 



KSiN 

(3) (41 



_F_OSTTEST _ ppetest CWMMHCE RA« CHANGE EFFECTS 

s A r ^T^ ADJUSTE0 GiIM * R 

(5 > (6) (71 (ft) 



(9) (10) 



GAIN EFFECT TX1 TX2 T 
(U) IK) (13) (14) (IS) 



VOC ATT 


11.390 


4.270 


22.441 


4.200 


22.492 


21.377 


4.028 


21.923 


4,275 


21.691 


JC9 K*5H 


22.446 


3.713 


22.793 


3.643 


22.881 


22.684 


3.353 


22.705 


3.222 


22.617 


JOB NOLO 


53.735 


2.201 


30.976 


2.434 


30.955 


30.569 


2.239 


30.689 


2.499 


30.710 


mi 


49.033 


6.369 


53.562 


6.897 


50.773 


■♦9.579 


6.644 


49.920 


6.780 


49.709 


JCS SEEK 


12.571 


2.633 


13.115 


3.035 


13.139 


12.564 


2.429 


12.664 


2.672 


12.641 


SEX STER 


45.821 


8.353 


47.663 


8.434 


47.406 


44.907 


8.142 


45.113 


8.413 


45.390 


SELF EST 


36.750 


2.933 


36.523 


3.406 


36.797 


36.716 


2.951 


36.771 


3.212 


36.782 


STEP 


16.220 


3.931 








16.370 


3.766 







*T significant at p * ,05 confidence level 
7 significant at p ■ ,01 confidence level 
T just short of significance: p . ,06 confidence level 



0-M 0.125 0.01 0.08 3.73<» 



0.077 0.094 -0 

0.099 0.052 0 

0.15* 0.167 -0 

0.175 0.165 0 

0.239 0.199 0 

0.004 0.001 0 



,73<« 

02 0.04 1.92* 

04 0.07 2.3«* 

02 0.07 4.52m 

01 0.10 4.45«* 

07 0.16 6.47#< 

01 0.01 0.11 
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TABLE 3 



NATIONAL COUNCIL OF NEGRO WOMEN 



PJLPTICIPANTS CONTPOLS EFFECTS 

N = 82 N = 103 

COVARXANCE RAW CHANGE EFFECTS 

pocTEST PPSTTEST PRETEST POSTTEST AOJUSTEO GAIN R R 

Sfi S.O. HE AN S.O. AOJ MEAN MEAN S.O. MEAN S.O. AOJ MEAN GAIN EFFECT TX1 TX2 T 
I (2) (3) (4) (5) (6) (7) (8) (9) (10) (11) (121 (13) (14) (15) 



21.699 3.928 22.938 3.859 22.784 0.107 0.152 -0.08 0.01 0.94 

23.056 2.718 23.352 2.736 23.327 0.144 0.293 -0.10 0.03 1.09 

30.924 1.737 31.271 1.749 31.150 0.451 0.446 -0.09 0.19 3.51** 

49.918 6.356 49.895 6.807 49.802 0.090 0.082 -0.02 0.04 0.91 

13.009 2.470 13.139 2.374 13.139 0.630 0.655 -0.05 0.32 5. 19** 

46.671 8.664 46.371 8.638 46.502 0.474 0.450 0.02 0.25 4.54m 

37.468 2.679 37.780 2.812 37.803 -0.054 0.091 -0.12 -0.09 -0.46 

16.491 3.578 



1.190 


4.266 


23.016 


3.338 


23.170 


!2.573 


3.088 


23.695 


2.726 


23.720 


SO. 60s 


2. 373 


31.784 


1.599 


31.905 


♦9.761 


6.651 


50.2«1 


6.165 


50.364 


L2.963 


2.197 


14.634 


2.371 


14.634 


♦6. 935 


7.753 


50.297 


6.633 


50.166 


37.095 


3.073 


37.669 


2.974 


37.646 


L6.915 


2.742 









tlf leant at p = .01 confidence level 
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TABLE 4 



RECRUITMENT AND TRAINING PROGRAMS 



N = 136 



CONTROLS 



N = 197 



EFFECTS 



PPETEST 



MEAN 
(II 



S.O. 
iZ) 



POSTTEST 



KEiN S.O. AO J MEAN MEAN 
( 3) (41 tS) (6) 



PRETEST 



5.0. 
(7) 



MEAN 
(8) 



POSTTEST 



5.0. AO J MEAN 
(9) (10) 



£1.271 3.996 22.,38 ,.639 22 .6,8 zlM7 ^ ^ ^ ^ 

2209S 3 ' 931 3 ' 7 " ".587 23.701 3.611 22.32. 3.445 21.895 

30.759 2.010 31.14* 2.011 31.233 30.^0 2.260 30.273 3.009 30.166 

«9.C93 6.993 51.237 7 .027 51.670 49.644 6.720 ,9.350 7.185 ,8.917 

U.600 2.719 13.231 2.7,5 13.281 12.,26 2.382 12.321 2.877 12.273 

*5.3<6 8.331 ,8.5:9 8.481 , 8 .351 ,,.718 7.8,8 , 3 .699 9.237 ,3.877 

3-710 2.983 36.759 3.300 36.775 36.503 3.051 35.955 3.633 35.938 

17.8,1 3.093 



16.769 ,.056 



COVARIAMCE RAW CHANGE 

ADJUSTED GAIN R 

GAIN EFFECT TX1 

(HI (Id (131 



0.,63 0.,82 0.01 

0,,69 0.,,, -0.03 

0.417 0.230 0.11 

0.367 0.320 0.0, 

0.359 0.375 0.12 

O.505 0.,96 0.07 

0.3,1 0.18, 0.07 



ficant at p = .05 confidence level 
ficant at p = .01 confidence level 



EFFECTS 
R 

TX'2 T 
U4> (15) 



0.35 5.10** 

0.34 5.1,«* 

0.22 3. 66** 

0.23 ,.76«* 

0.23 3.76** 

0.27 5.3,** 

0.14 2.27* 
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TABLE 5 



NATIONAL URBAN LEAGUE 



PJPTICIP&HTS 



N = 247 



CONTROLS 



N 



144 



EFFECTS 



PRETEST 
AN S.O. 
) (2) 





POSTTEST 




PRETEST 




POSTTEST 




ADJUSTED 


GAIN 


rEAN 


S.O. 


ADJ MEAN 


MEAN 


S.O. 


MEAN 


S.O. 


ADJ MEAN 


GAIN 


EFFECT 


(3) 


(4) 


(5) 


(6) 


(7) 


(8) 


(9) 


(10) 


(11) 


(12) 


22.689 


4.033 


22.101 


19.709 


4.111 


21.727 


4.265 


22.315 


-0.052 


-0.233 


22.643 


3.660 


22.590 


22.243 


3.619 


22.174 


3.755 


22.231 


0.097 


0.073 


30.382 


2.735 


30.364 


30.194 


2.417 


30.324 


2.604 


30.342 


0.008 


0.041 


49.880 


6.571 


49.608 


47.765 


6.613 


48.723 


6.569 


48.994 


0.093 


0.067 


12.854 


3.030 


12.681 


12.285 


2.629 


12.154 


2.912 


12.326 


0.119 


0.101 


45.162 


7.774 


44.366 


42.059 


7.958 


42.662 


7.711 


43.438 


0.122 


-0.011 


36 . 3C6 


3.743 


36.329 


36.228 


3.156 


36.343 


3.587 


36.321 


0.002 


-0.019 



COVAPIANCE RAW CHANGE EFFECTS 

R R 

TX1 TX2 T 

(13) (14) (15) 



0.067 0.03 0.07 1.23 



0.101 0.C6 0.09 1.47 



'I 



I 

H 

f 



15.490 4.057 



14.957 4.139 
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TABLE 6 



U.S. EMPLOYMENT SERVICE 



PARTICIPANTS CONTROLS 

N= 138 " ^PlS EFFECTS 



POTEST PQSTTEST PPfW pnCTTcet COVAPXANCE RAH CHANGE EFFECTS 



0.778 4.015 21.656 ,.875 H.014 21.480 3.926 22.10, ,.152 21.7,5 0.060 0.060 -0.06 -0.00 0.71 

2.309 3 .,12 21.701 ,.3,5 21.663 22.608 3.067 22.81, 2>8 ,2 22>657 , „ _ fl Jg _ g ^ 

0.8,6 2.030 30.710 2.731 30.663 30.535 2.123 30.689 2.,12 30.736 -0.028 -0.125 0.09 0.32 -0.25 ? 

8.525 6.471 48.837 7.280 ,9.2,6 ,9.338 7.113 ,9.756 7.108 ,9.3,7 -0.01, -0.008 -0.0, -0 0, -0 17 

2-365 2.5,7 12.131 3.215 12.309 12.807 2.111 12.675 2.489 12.497 -0.066 -0.039 -0.07 -0.06 -0.70 

5.156 8.377 ,5.382 7.6,8 45.435 ,,.733 7.292 ,5.058 7.281 ,5.005 0.058 -0.013 0.08 0.C3 ,.„ 

i.882 2.661 36.772 3.229 36.769 <6.861 2.860 36.827 2.870 36.830 

l ' 110 3 - 925 16.428 3.060 



-0.020 -0.026 0.01 -0.01 -0.21 



Leant at p = .05 confidence level 
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TABLE 7 



WOMENS BUREAU 



PtaTICIPANTS 



M = 141 



CONTROLS 



N = 



EFFECTS 



COVARIANCE RAW CHAN3E EFFECTS 



FPE 


TEST 




POSTTEST 




PRETEST 




POSTTEST 




ADJUSTED 


GAIN 


R 


R 






S.D. 


KSAN 


S.D. 


ADJ MEAN 


MEAN 


S.D. 


MEAN 


S.D. 


ADJ MEAN 


GAIN 


EFFECT 


TX1 


TX2 


T 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


(3) 


(9) 


(10) 


(in 


(121 


(13) 


(14) 


(15) 


Zl. 733 


4.542 


21.855 


4.098 


21.962 


22.428 


4.076 


23.303 


3.648 


23.225 


-0.318 


-0.188 


-0.10 


-0.21 


-3.03** 


22.242 


3.631 


22.007 


3.710 


22.144 


22.609 


2.930 


22.707 


2.998 


22.570 


-0.127 


-0.104 


-0.04 


-0.03 


-1.12 


31.1C6 


2.213 


30.952 


2.725 


30.911 


31.164 


1.948 


31.408 


1.664 


31.449 


-0.245 


-0.186 


-0.02 


-0.11 


-1.76 


49.683 


6.757 


53.005 


7.133 


50.401 


50.545 


6.096 


50.388 


6.509 


49.992 


0.060 


0.072 


-0.09 


-0.03 


0.60 


12.241 


2.554 


11.931 


3.067 


12.037 


12.717 


2.309 


12.622 


2.593 


12.517 


-0.170 


-0.082 


-0.08 


-0.12 


-1.49 


43.659 


9.393 


51.076 


8.929 


51.030 


47.985 


6.298 


50.050 


7.525 


50.095 


0.114 


0.041 


O.01 


0.06 


1.14 


3i>.930 


2.700 


36.952 


3.130 


36.681 


36.336 


2.903 


36.835 


2.919 


37.105 


-0.140 


-0.164 


0.07 


-0.03 


-1.07 


15.422 


4.491 








15.560 


4.546 



















I 



lif leant at p = .01 confidence level 



37 



38 
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TABLE 8 



SIR JOSS FOR PROGRESS 



U z 



CONTROLS 



N = 157 



EFFECTS 



'EST 



S.D. 
(2) 



FITTEST 



S.D. AD J M£AN MEAN 
(4) (5) (6) 



PPETEST 



S.D. 
(71 



MEAN 
(8) 



POSTTEST 



S.D. AOJ MEAN 
(9) (10) 



21.379 4.343 22.938 3.775 22.944 21.833 5.786 22.089 3.744 

22.031 3.099 23.711 2 .679 23.392 22.936 3.618 23.223 2.987 

31.221 1.813 31.540 1.782 31.180 30.541 2.511 30.717 2.465 

".436 7.440 52.970 6.373 52.719 50.573 6.196 51.656 5.800 

12.613 2.543 14.360 2.572 13.807 12.333 2.573 13.242 2.427 

*.542 8.127 48.676 8.635 46.793 44.924 7.971 45.542 8.006 

57.072 2.664 37.070 3.389 36.543 36.982 2.783 37.333 2.676 

16.049 3.846 



22.133 
23.542 
31.078 
51.907 
13.795 
47.425 
37.610 



.7.331 3.113 



Eicant at p = .05 confidence level 

short of significance: p = .06 confidence level 



COVAPIANCE RAW CHANGE EFFECTS 
ADJUSTED GAIN R R 



GAIN 
(11) 


EFFECT 
(12) 


TXl 
(13) 


TX2 
(14) 


T 

(15) 


0.215 


0.346 


-0.02 


0.09 


1.93 1 


-0.053 


0.159 


0.00 


-0.02 


-0.46 


0.048 


0.067 


0.17 


0.09 


0.44 


0.133 


0.581 


-0.03 


0.05 


1.27 


0.005 


r 31 


0.03 


0.01 


0.08 


-0.376 


0.308 


0.03 


-0.02 


-0.69 


-0.253 


-0.138 


0.05 


-0.09 


-2.14* 



I 

to 
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Relationships Between Psychometric Gfrins and Fol Inu- 

up Outcomes 

Are test score gains as defined by the psychometric battery valid pre- 
dictors of key short term labor market outcome variables? Assuming 
that test score gains in certain a ^tudinal and knowledge areas can be 
demonstrated to be related to labor market outcomes, policy makers at 
the program level can emphasize the development of skills and/or 
attitudinal changes in those more promising areas. Table 9 presents, for 
each delivery agen^, the subset of the psychometric measures which 
demonstrated statistically significant relationships between pre-post 
gain and one or more of four outcome measures (column 1, 2, 3, and 4) 

from the 3-month follow-up questionnaire. Those four labor market out- 
come measures are (1) Presently working full-time or not, (2) Quality 

rating* of the job in which one is presently employed, and (3) Quality 

rating of job aspired to, and (4) positive activity status. The positive 
activity etatus is a three point scale where a score of two indicates 
one is working or going to school full time or doing both part time* a 
score of one indicates that one has worked full time and/or is working 
part time or going to school part time; and a score of "0" indicates 

none of the above activities. 

Inspection of Table 9 indicates that with the exception of gains 
on Vocational Attitude for the Urban League, none of the pre to post 
gains In nttltudlnnl and skill areas were related to whether one 1h 
working full-time. The number Inside the parenthesis (.24 in this case) 

*Appcndlx (} pnuRMitH job Krooplngs which nro scaled on a 1-5 point 
status srah'. "IIIrIi Status" Jobs Indicated by scale points 3-5 tend to 
be flcml-rtk tiled (scale point 3) skillod (scale point 4) and professional 
(scale point 5) • 



ERLC 



Table 9 



Relationships Between Test Score Gains and Selected >tonth Follawp Outccoes by Delivery Agent 



1 



Delivery Agents 

National Council 
on Negro Wcren 

Recruitment and 
Training Program 



Presently Working Quality Rating of 
full-Tine Present Full-Tlae Job 

01 2L__ 



Quality Rating of 
Job Aspired to 

2L_ 



Biployed, lull-time 
Going to School Hull-tics 
or Doing Both Part-tine 
ft) 



Moral Attitude * (.30) Vocational Attitude * (.33) 
Sex Stereotypes ** (,40) stereotypes ** j^j 



Job Holding ** (.18) 



Sex Stereotypes ** (.21) 



National Urban 



Vocational 
Attitude (.24) 



U.S. Etaploynent 
Service 



Job Knowledge* (.22) 
Job Holding (.27) 
Self Esteem (.34) 

Job Knowledge (.23) 
Job Holdii^ (.23) 
Job Seeking (.24) 
Self Esteem (.31) 



Vocational Attitude ** (.25) 
Job Knowledge ** (.25) 



Self Estean (.22) 



focatioral Attitude (.33) 
Job Holding (.33 




Work Relevant Attitudes (.29) 
Sex Stereotypes * (.22) 



Job Knowledge ('20) 



Totals 



Women's Bureau 

m Vocational Attitude * (.16) 

Job Knowledge (.16) 
Work Relevant Attitudes * (.18) 
Sex Stereotypes (.27) 
Self Esteem (.37) 

Vouitional Attitude* (.17) 
Job Knowledge (.14) 
Job Holding * (.20) 
Work Relevant Attitudes * (.09) 
Job Seeking * (.16) 
Sex Stereotypes* (.18) 
Self Estean (.25) 

I fort correlations between gain and the particular outcane are shown In parentheses. 

I'^IT 3 mmM m m of ' 10 * • standard deviation 
or greater on this measure. 

4 2 ^If! *"* 8 Statkittlly slgnlflcailt ***** P*> over controls > .10 of 
* w a standard deviation. 



Job Holding (.09) 
Sex Stereotypes (.09) 



Vocational Attitude ** (.13) 
Job Knowledge (.14) 
Job Seeking ** (.12) 



is a part correlation indicating the strength of the relationship between 
gains in the particular tested areas 'Vocational Attitude) and whether or 
not one is working full-time 3 months after program completion. 

When the quality of the present job is the criteria, gains on 
almost all the measures appear for one or more of the delivery agents as 
valid predictors. The more stable estimates of the Importance of galas 
in specific attltudlnal and skill areas are the part correlations for the 
total participant sample. It appears that gains in Self E3teem (.25) 9 
Job Holding Skills (.20), Sex Stereotypes (.18), and Vocational Attitudes 
(•17) are the more highly predictive of quality of employment. Of the 
remaining measures, the least useful predictor of quality of employment 
is the Work Relevant Attitudes Inventory (.09). When one looks at the 
relationship between gains in attitudes and skills and jobs "aspired" to, 
Improvement in occupational sex role perceptions as measured by the Sex 
Stereotyping measure appears to be the best and most consistent predictor. 

Inspection of the relationship between test score gains and positive 
activity status indicates that vocational attitudes, job knowledge, 
and job seeking skills are significantly related to positive activity 
status for the total YCD population. This index (positive activities) 
includes going to school, which in turn requires certain verbal abilities 
which are partially measured by the job knowledge and job seeking skills 
instruments. 

It should be noted here that the fact that delivery agents show that 
gains by their participant*} mny be relnted to desirable labor market 
outcomes does not necessarily imply that their particular program brought 
about significantly greater mean gains than were observed in the control 
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group. Because some individuals within a program gain, and their gain 
turn is related to a post program outcome, this does not necessarily mei 
that the program participants on the average gained more than their 
controls. For example, participants in the SER program who gained in jo 
knowledge are more likely to be employed in a higher level job than those 
who either did not gain or gained less. However, inspection of Column 11 
in Table 8, the test score gains analysis, indicates that the SER 
participant adjusted mean gain is less than th* controls. In order to 
Include information on not only whether a particular delivery agent's 
participants' gains are related to desirable outcomes, but also whether 
that delivery agent succeeded in bringing about a positive mean increment 
relative to thi r control group, a one and two asterisk legend is used. 
One asterisk indicates that there was a program related mean gain of at 
least .10 of a standard deviation over that shown by the control group. 
If the gain of .10 of a standard deviation or greater is also statistically 
significant, two asterisks are placed on the associated tested attitude 
or skill. 

Table 10 presents the relationship between gains on test scores 
and probabilities of: (1) being employed full-time, (2) being employed 
in a semi skilled or skilled job (if working full-time), (3) aspiring to 
a semi skilled or skilled job and (4) working full-time, or going to 
school full-time, or doing both part time. For each tested attitude or 
achievement area, participants are assigned to one of three groups 
according to their ndjuflted gnlnn on encli rcflpectlve teat «core. The 
three groups arc indlvldtmla who fall In the upper quartile (top 25% 
of the g/ilners), the middle group of p.nlnerH Hpnnntnp, the 26th to 74th 



Table 10 



SAB 

INSTRUMENT 



VOC, ATT. 

Upper Quartile (Q, ) 
Middle (Q. + Q ) 1 
Lower (Q ) 
JOB KNOWLEDGE 
Upper Ouartile (Q.) 
Middle (Q. + Q ) 
Lower (Q j 
JOB HOLD SKILLS 
Upper Quartile (Q ) 
Middle % + Q ) 1 
Lower (Q.J 
W R A I 

Upper Quartile (Q ) 
Middle (Q + Q ) 1 
Lower (QJ 
JOB SEEKING SKILLS 
Upper Quartile (Q. ) 
Middle (Q, + Q ) 
Lower (QJ i 
SEX STEROTYPES 
Upper Quartile (Q,) 
Middle (Q, + Q ) 
Lower (QJ 
SELF ESTEEM 
Upper Quartile (Q.) 
Middle (Q + Q ) 1 
Lower fyf i 



PROBABILITIES OF DESIRED LABOR MARKET OUTCOMES OCCURING 
DEPENDING ON WHETHER A YCD PARTICIPANT IS A "BIG" GAINER, 
"AVERAGE" GAINER, OR "BELOW AVERAGE" GAINER ON EACH OF 
THE PSYCHOMETRIC INSTRUMENTS 

PROB. OF PRESENT PROB, OF ASPIRING PROB. OF WORKING OR 
PROB, OF FULL- JOB BEING SEMI- TO SKILLED OR SEMI- GOING TO SCHOOL FULL- 
TIME EMPLOYED SKILLED OR SKILLED SKILLED JOB TIME OR DOING BOTH PART-T?<E 
til 111 (3) m 



29 


62 


82 

V la 


71 


24 


51 


90 


71 


25 


35 


73 


56 


31 


50 


84 


/ j 


23 


54 


84 


10 

/u 


25 


44 


83 


52 


25 


53 


88 




26 


51 


85 


07 


24 


43 


74 


65 


28 


55 


85 


77 


25 


52 


82 


63 


26 


42 


86 


64 


22 


54 


89 


71 


28 


55 


79 


70 


25 


38 


89 


58 


24 


58 


86 


70 


27 


51 


85 


67 


23 


40 


77 


64 


20 


59 


83 


68 


25 


58 


87 


67 


29 


26 


78 


65 
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percentile, and the third group of "gainers" in the lower quartile. 
Columns 1-4 show the probabilities of the desired event occuring for a 
"typical" individual in each of the three groups of gainers. 

The quartile groupings in Table 10 are based on percentile ranks 
according to gains adjusted for initial status. Raw gains would not 
yield gain scores independent of initial status, and thus would favor 
the low scoring pretesters. Unfortunately the metric of adjusted gains 
is not readily translatable into the raw score point scale. A gross 
approximation would be that an individual near the mean on the pretest, 
on the average, would need to gain at least .67 of a standard deviation 
to move into the upper quartile. Inspection of the probabilities 
associated with the top 25% of the test score gains indicates that for 
measures such as vocational attitudes and self esteem, an individual in 
the upper quartile of gainers could substantially increase his probability 
of having a higher skilled job than a person who was in the lower quartile 
with respect to gains. One interesting finding here is the reverse 
relationship between self esteem and the probability of being employed 
full-time. It would appear that gains in self esteem are negatively 
related to working full-time, yet appear to be positively related to 
getting the higher skilled jobs. This is an example of where increasing 
one's self esteem may lead to on* rejecting low level "dead end" jobs, 
and thus the employment rate Cor Uivldnnla with Increased self esteem 
may be lower than those showing no pouitive change. In general, the 
results In terms of probnbfl • t Mn nre consistent with the presentation In 
Table 9 of the correlation of gain on test scores and the four criteria. 
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In general, it may be concluded that gains in almost all tested 
skill and aptitude areas should be goals of the programs because of 
their apparent relationships (i»e., the gain scores) with one or more 
relevant employment behaviors* It would seem that special emphasis should 
be placed on attltudlnal areas, in particular Job holding skills, vocational 
attitude, self esteem and occupational sex stereotypes, because of their 
possible causal effect on quality of present and future employment* 
Job knowledge also emerges as a target for change since gains are related 
to positive activity status. The next section of this report suggests 
however, that program participation does not necessarily lead to positive 
gains in self esteem and/or sex role perceptions "across the board", but 
many such gains are manifested within certain subgroups of the population. 

Who Gains? 

Youth training programs may have a differential impact; on youth 
depending on their abilities and previous environmental experiences. The 
question here is who seems to profit most, as measured by gains in work 
related attitudes and knowledge among the YCD youth. Table 11 shows the 
background characteristics and abilities of YCD participants who gained 

the most (as measured by the psychometric battery scores) for all programs 
combined. These gains are shown by each knowledge and attitudinal con- 
struct and are corrected for pretest score levels. This ANCOVA type of 
computation yields demographic correlates of gain which are independent 
of an individual's pretest score. The profiles of gains are shown within 

each column (tested Area) and are interpreted as follows. Using the last 
column as an example, one would conclude that amonj; those individuals 
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Table 11 



SIGNIFICANT INDIVIDUAL CHARACTERISTICS WHICH PREDICT GAIN FOR EACH ATTITUDE AND KNOWLEDGE MEASURE 1 



Characteristics 
of Youth 

Reading 
Ability — 



Sex 
Male - "1" 
Female ■ "0" 



Econstat 

4 - High 
Advantaged ■ "1" 



"0" 



Ethnic 
white - "1" 
Other ■ "0" 

Ever work 
Yes * "1" 
No -"O" 



Skill and Attitude MeaaurPfl 

Vocational Job Job Holding Work Related Job Seeking Sex 
Attitude Knowledge Skills Attitudes Skills Sterotypea 



Yes 
* 



Yes 



(b -.26) (b 



No 

(b*-- -.05) 



Yes 
(b*-.28) 



Female 
(b*-.09) 



Yes 
(b*-,27) 



Yes 



Yes 

* * 
(b -.42) (b -.17) 



Female 
* 



Self 
Esteem 



Yes 
(b*-.27) 



Female 



(b -.07) (b -.08) 

^ Low 
(b -.08) 



Disadvantaged 
(b*— .06) 



non-white 
(b*— .08) 



non-white 
(b*-.ll) 



Significant" & ™ * ^ ^ the afl8 ° Ciated pflrtlal regres8lon wel * ht 



I 

U 

0 

I 



was not 



in 



51 



with the same self esteem level at pretest time, low economic status 
black women with higher reading scores are likely to gain the most. The 
second to last column indiciates that positive improvement with respect 
to sexual stereotypes is greater for disadvantaged females who have 
relatively high reading ability. The overall results of the analysis 
suggest that gain in every area requires at least some reading ability 
and this is a consistent finding regardless of whether we are talking 
about gains in knowledge or attitudinal change. For the most part, 
where there is a differential gain it is in favor of females whether 
disadvantaged, black, or both. The reader will note that with the 
exception of reading level, the effects of the demographic characteristics 
are relatively small (typically less than . 10 of a standard deviation) 
even though they are statistically significant. With the exception of 
Sex Stereotypes and Self Esteem, one would have to conclude that in most 
of the measured attitudes and skills, the gains are pretty much across 
the board given equivalent reading levels. 
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Analysis of Covariance Adjuste d Effects a t 3-month Ealltafcup 

The participants and control group means were computed for each of a 
subset of items 1 on the 3-month program Follow-up Survey. The results 
of these comparisons are shown in Table 12 which presents the adjusted 
means and the covariance adjusted effects for all programs combined. 
Appendices H-M present the same comparisons within delivery agent. As 
in the previous analysis, the group means were adjusted for preexisting 
differences on reading scores and demographics. Inspection of the "T" 
values indicate that the participant and control groups differ significantly 
on items 13, 15, 25, 26, 47, and 53. Inspection of the sign of the 
adjusted effects associated with the significant "T's" suggest that 
program participants differ from control group members in that if they 
are presently a full-time employee they have: (1) a higher status level 
Job, and (2) filled out more applications and had more interviews to get 
their first full-time job. Also they (the participants) are more likely 
to express confidence in their knowledge of a hypothetical job that they 
"might be looking for", and to report that they are more likely to 
buy things on credit than those in the control group. 

It would appear that while participation in the YCD program did not 
significantly increase your chances of being a full-time employee 3-months 
after the program, (item 10), it (program participation) did increase the 
likelihood that you would have a "better" job (item 13) , More discussion 
of this result follows in the next section. These preliminary results 



Certain items were omitted from the analysis because they were 
inappropriate for the control group and/or preliminary data editing 
procedures suggested there were serious inconsistencies with the 
responses. 
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Table 12 



ANALYSIS OF ODVARIANCE ADJUSTED EJECTS FOR PARTICIPANT AH) OONIBOL GtflJP CCMPARI9CNS Qi 3-W fOUXW-UP 



rrat 

10 Working full-tine now? 
13 Job title? 

15 Hours worked per week? 

16 timber weeks on Job? 

17 Hourly wage? 

25 Nmber applications for jobs? 

26 Nmber of interviews? 
29A Nmber of raises? 
31-35 Feelings about job? 

38 Now in school or training? 
41 
42 
47 
51 
52 
53 
55 
57 



fat ouch do you taow about job? 
How such do you give your family 
How often do you save? 
Do you buy on credit? 
too 



Activity Status 



1 





PAKnCXPANrS 














ATM 






ADJ. 


MEAN 


S.D. 


MEAN 


nuvi 


jsUs 


MEAN 


.246 


,430 


•255 


•ZjI 


AU 


.242 


2.388 


.86? 


2e389 




•om 


2.258 


39.360 


fc.039 


JMZ! 


Afl llfi 


7 2M 


40.247 


A A 4 P 

9.315 




A CIA 


7«JW 


5 WW 

JeOOO 


9.102 


3.337 




hSil 


1 A71 
Jet/1 


•74H 


3.411 


A A« J 

2.874 






9 1 


1 471 

Js4/l 


2.521 

4eV£l 


1.497 


2.01/ 


1 AM 




1 AM 


1.240 

ie*Tv 


.447 


.738 


•WO 


A57 


750 


.444 


10.894 


2.373 


10*935 


11 AAA 


9 9S4 


11.007 


.565 


.496 


.565 


.565 


.496 


.565 


4.216 


1.532 


4.286 


4.311 


1.417 


4.242 


1.596 






1 AOS 


.846 


1.512 


2,335 


.642 




2.199 


.676 


2.189 


19.322 


22.084 


18.991 


20.361 


22.514 


20.692 


.946 


.226 


.950 


.935 


.247 


.930 


1.123 


.343 


1.131 


1.080 


.285 


1.073 


13.427 


.720 


13.432 


13.500 


.709 


13.494 


2.939 


.245 


2.938 


2.930 


.268 


2.931 


1.273 


.705 


1.288 


1.274 


.715 


1.259 



OOVARIAiNCE 
ADJUSTED 
EFEBCT 

.031 

.149 
-.123 

.075 
-.017 

.110 

.139 

.023 
-.031 
-.001 

.030 

.082 

.237 
-.076 

.085 

.185 
-.087 

.027 

.040 



T 

.56 

2.88** 
-2.30* 

1.37 
-,40 

2.03* 

2.45* 

.41 
-.56 
-.02 

.59 

1.50 

4.37** 
-1.44 

1.55 

3.37** 
-1.59 
.49 

.75 



1 A derived variable coded as folios: 

0- never voted full time or part time since leaving the program, and not going to achool 

1 - previously wilted full, or wrked part time since leaving the program, or go:' 

2 ■ now working full tint, or going to school full time, or doing both part time 



suggest that the overall productivity of the participant group is increased 
more easily by improving their skill levels rather than increasing the 
total number employed. The fact that participants filled out significantly 
more applications and attended more interviews is consistent with what 
appears to be a greater tendency to aspire to, and to obtain higher 
status jobs. The fact that participants report that they feel that they 
know more about the job that they would like to have is suggestive that 
the program is increasing their confidence and knowledge of the world of 



work. 



Table 13 presents pptticipant and control group comparisons by 
delivery agent in terms of relative probabilities of: (1) being employed 
full-time, (2) being employed in a skilled or semi-skilled job rather 
than an unskilled job, (3) aspiring to a skilled or semi-skilled job 
rather than an unskilled job AND (4) being involved full-time in a 
positive activity. These participant and control group probabilities 
are adjusted for group differences in reading level and the previously 
specified demographics. Because of the ANCOVA adjusted dichotomous 
criterion variable, e.g., working vs not working, the usual statistical 
tests of significance of the resulting probabilities are not appropriate 
and thus not shown. This dichotomization of the follow-up outcomes 
allows one to report the strength of relationship between program 
participation and certain desired behaviors in terms of easily 
understood probabilities. For example, the entries for the National 
Urban League suggest that while the program participants are less likely 
to be working full-time three months after the program, those that are 
working are more likely to be in a skilled or semi-skilled job (P=.38) 
than those in the control group (P-.17). That is, out of every 100 



TABLE 13 



Participant-Control Group Comparisons with Respect to 
Selected 3-month Follow-up Outcomes by Delivery Agent 



a 

Outcome Probabilities 



Probability of Probability of Present Probability that Job Probability of Working 

Delivery being presently Job Being Skilled or Aspired to is Skilled or Going to School Full 

Agents Employed Full-time Semi-Skilled or Semi-Skilled Time or doing both Part Time 

Partic Control Partic Control Partlc Control Part'ic Control 



National Council 

of Negro Women .13 .27 .61 .46 .80 .81 .80 .84 

Recruitment and u 
Training Program .19 .14 .40 .38 .73 .66 .69 .68 w 



National Urban 
League 



,24 .28 .38 .17 .78 .74 .55 .48 



U.S. Employment 

Service .30 .32 .51 .40 .84 .80 .53 .69 



Women's Bureau .23 .15 .48 .30 .90 .66 .76 .39 

SER .37 .32 .58 .72 .92 .90 .78 .67 

Totals .26 .24 .51 .46 .82 .78 .67 .67 

a Entries in this table are probabilities adjusted for pre-existing differences' between groups 
and demographics. 
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participants who were in the program and subsequently working full time, 
38 will be in skilled or semi-skilled jobs. Similarly, out of every 100 
non-participants (control group members), only 17 will have jobs at 
comparable skill levels. 

Inspection of Table 13 indicates that RTP and Women's Bureau have 
the better success rates on all four criteria. It is interesting to 
note that while SER participants are slightly more likely to be working 
full-time, they are the only delivery agent which shows a greater 
likelihood that their participants will be in low level jobs than 
comparable non-participants. The Women's Bureau probabilities are 
interesting in that they show the greatest discrepancy from the control 
group in their probabilities of aspiring to a skilled or semi-skilled 
job. It would appear that female participants are a good target group 
for improving job aspirational levels. Undoubtably, much of this 
improvement in job aspirations of Women's Bureau participants is due to 
changing their perception of sex roles. This result is consistent with 
the fact that women tend to gain more on the sex stereotype measure (see 
previous discussion on "who gains"). Also, the only measure on which 
the Women's Bureau participants gained more than .10 of a standard 
deviation was the sex stereotype measure. 

In summary, the results in Table 13 show that participation in YCD 
programs leads to: (1) approximately a 2% gain in full-time employment, 
(2) a 2% increase in the number of people employed in skilled and semi- 
skilled jobs, (i.e., the product of .26 x .51 and .24 x .46), (3) a 4% 
increase in the number of people aspiring to skilled and semi-skilled 
Jobs and (4) a IX increase in those occupied working or going to school 
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full-time or doing both part time. Within delivery agent, there are 
considerable differences among the success rates with respect to those 
four criteria. At the top we have RTP and Women's Bureau and at the 
bottom we have National Council of Negro Women. One additional caution 
is in order here. It may well be that the criteria of placement in a 
full-time job within 3 months of program completion may have little 
to do with long-run program impact. In fact, placement in low level 
dead-end jobs, or in jobs where the working conditions are poor, may lead 
to heavy turnover rates when considered on a long term basis. Conversely, 
those individuals who will search for jobs in which they use skills 
acquired in their training and which offer real long term opportunities 
are going to be the more productive members of our society. Gay and 
Borus (1980), in their study of validiation of performance Indicators for 
employment programs, present data suggesting that relatively immediate 
job placements withe t regard to the quality of placement may not be 
useful indicators of program effectiveness. 

Table 14 presents a summary of program related gains in the test 
score areas (Columns 1 and 2), as well as a summary of program impacts on 
the three selected criteria areas from the 3-month Follow-up Survey 
(Columns 4 and 5). The entries in columns 1 and 2 are simple counts of 
the number of times the participant groups adjusted posttest mean scores 
were higher than the control group's adjusted posttest mean scores. 
The column 2 entries simply reflect the more stringent criterion that 
the participant gain must be at least 10% of a standard deviation greater 
than that of the control group. If a delivery agent's participant group 
gained more than the controls on all seven measures, then that delivery 
agent would have a score of seven in column 1. 

er|c m 



Table 14 



Indices of Merit and Rankings by Delivery Agent 



Delivery Aeent 


Merit Indices of iw r. fl i„ 0 a 
Number or Number of Rank 
Positive Positive Based on 
Gains Gains > .10 Column 2 

.0 (2) n\ 


Do. hnpioynent 








Service 


2 


0 


6 


National Urban 








League 


6 


3 


3 


Women's Bureau 


2 


1 


5 


National Council of 








Negro Woien 


6 


5 


2 


SER 


4 


2 


4 


RTP 


7 


7 


1 



Number of 



Merit Indices for t'ollowup* 



Rank 



Positive Number of Positive Based on 
Differences Differences > .10 Column 5 



3 

4 

1 
3 

4 



(5) 



2 
4 

1 
1 



2 
1 

3 
3 
2 



i 



1 K sea : asri t'^ir^ *- -~ 

times the participant adjusted post- est mea is M !" C0UntS of the number of 

skilled or seri-skllled 1o n 41 ! I . " Skilled job, and (3) aspiring to a 

« greater than t . „e n l" 8 TS ^\ m .^ « «1 both part the 

probabiutj * te * ^ « • «ss d . 1 e ; e ° £ rrr ? e patticipant 

score here is 4. 8 eater than the contr °l group. A perfect 



Column', ■■>, and 5 are parallel counts for the four selected areas from 
the 3-month Follow-up. A score of four in column 4 for a particular 
delivery agent indicates that members of the participant group are more 
likely than the control group: (1) to have a full-time job, (2) to be 
working at a skilled or semi- ski Ixed job, (3) to aspire to a skilled 
or semi-skilled job and (<0 be occupied full-time in a positive activity. 
The column 5 entrees, as before, simply add the more stringent requirement 
that the participant group effect be at least .10 of a standard deviation. 

Inspection of Table 14 indicates that, with the exception of RTP, 
delivery agent's performance iu achieving pre to post gains gives little 
hint regarding how well they (the delivery agent) will do with respect to 
job placement, job quality, and job aspiration. This result is not 
unexpected since gams on the test scores were unrelated to whether or 
not one was working full-time (see e.g., Table 9). 

The seeming lack of systematic relationships between participant mean 
gain on the test scores and quality of job placement and aspirational level 
may be due to (1) mean gains and correlation between gains and outcomes 
can be relatively independent,* (2) most of the participant mean gains 
were relatively small (with the exception of RTP), (3) the test battery 



The correlation of test score gain with outcomes is the relationship 
between Individuals changing their rank order from pretest to posttest 
and the relationship of this change in rankings to the outcomes. A 
mean level change from pretest to posttest could reflect the fact that 
everyone gained approximately the same amount and thus their rank 
orderings wouldn't change from pre to posttest. In such a case, there 
would be no correlations between test score gains and outcomes yet 
there would or could be a significant mean change from pre to posttest. 
This would be likely to occur if a delivery agent decided to "teach to 
the test." Then we would expect gains "across the board" but no 
changes in rank order, and thus no correlation between gain and 
positive outcomes. 
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does not measure vocational-technical skill levels, (4) community resistance 
to hiring minority youth in these age groups regardless of their training, 
and (5) three months is not a sufficient time lapse to evaluate impact of 
mean test score changes on labor market outcomes. 

To test out the hypothesis in (4) above, the demographic profile of 
the individuals who (1) find work, (2) have skilled jobs, and (3) have 
high job aspirations and (4) involvement in "positive activities full 
time" were investigated. Inspection of significant partial regression 
weights associated with demographic variables suggests that: 

(1) Those presently working differ from those not working in that 
they are more likely to be classified as advantaged rather than 
disadvantaged, have had previous employment, and are more likely to 
be males. 

(2) Those working on the more highly skilled jobs are more Ukely to be 
participants of a YCD program, have higher reading levels, high 
economic status, and be females. 

(3) Those aspiring to highly skilled jobs are likely to have higher 
reading levels. 

(4) Those more likely to be engaged in full-time schooling or work 
were more likely to be of higher economic status white and have had 
a past work history. 

In general, however, the prediction of the above four criteria from 
the demographic, was relatively low. That Is, the multiple correlations 
range from ;i low of K-.07 for aspirations to the middle thirties (R-.37) 
for quality of present job. It would appear that a good part of the 
variance in why certain delivery agents do better than others on the 
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3-month folio* -up is relatively unexplained by program related score 
changes and demographics of the individuals. It would appear that both 
job placement and quality of job placement may depend to a great extent 
on (1) post program counseling and placement services and (2) community 
availability of jobs. 

Table 15 presents additional participant control subgroup comparisons 
with respect to the our 3-month follow-up outcomes for the total YCD 
sample. Appendices R-W present the same results by delivery agent. The 
entries in the tables are probabilities of the four outcomes occurring, 
but which are not adjusted for preexisting group differences on demographic 
It is interesting to note that while males in both participant as well as 
control groups are more likely to be working full-time then females, the 
females are more likely to have more highly skilled jobs if they are 
working. Similarly, both white participants and controls are more likely 
to be working then are non-whites. These unadjusted percentages yield 
much the same conclusions as the regression approach to identifying the 
demographics of individuals who do well on the four criterion areas. 



TABLE 15 



Variable 



PARTICIPANT - CONTROL SUBGROUP COMPARISONS 
WITH RESPECT TO 
SELECTED 3-MONTH FOLLOW-UP OUTCOMES 
for 
TOTAL YCD 

(In Percentages)* 
PARTICIPANTS 

Joth Part-time 



Full-Tine 




SEX: 
M 


.29 


.38 


.79 


P 


.22 


.64 


.83 


RACE: 

Non-White 
Vhlte 


.23 
.35 


.53 
.52 


.81 
.88 


ECONOMIC STATUS: 
701 LLSIL 
71-851 LLSIL 
861 or more 


.25 
.27 
.16 


.51 
.63 
.36 


.81 
.84 
.80 


IMPLOYMENT PRIOR 
TO YCD: 








Employment 


.29 


.51 


.83 


No Prior 
Enploynent 


•16 


.61 


.80 


PREVIOUS CETA 
.PARTICIPATION: 








YES 
NO 


.26 
.24 


.55 
.53 


.86 
.82 


TOTALS 


.25 


.53 


.81 



.70 
.61 



.64 
.72 



.63 
.68 
.67 



.66 



.60 



.64 
.65 



.64 



,32 
.21 



.24 
.29 



.18 
.18 
.32 



.30 
.15 



.27 
.24 



.25 



.35 
.58 



.49 
.39 



.33 
.65 
.50 



.50 
.37 



.61 

.44 



.47 



.72 
.82 



.78 
.81 



.74 
.84 
.71 



.78 
.79 



.76 
.79 



.78 



.76 
.61 



.65 
.75 



.57 
.72 
.76 



.71 
.58 



.65 
.67 



.65 



Conclusion 

What have we learned from this preliminary analysis? We have 
learned in a modest way what seems to work, but we have little information 
on why some things worked and others did not. We have found that one 
delivery agent (RTP) Improved the knowledge and attitudes measured by 
test scores and also demonstrated positive outcomes in the four selected 
criteria from the 3-month Follow-up. One agent (Women's Bureau) performed 
well on the 3-month Follow-up Four criteria areas but apparently did 
little in the way of changing measured attitudes and knowledge, with 
the exception of sex stereotyping. Others did fairly well in bringing 
about changes in the test scores but demonstrated mediocre performance on 
both the 3-month Follow-up criteria (e.g., National Council of Negro 
Women and National Urban League). The U.S. Employment Service was 
characterized by relatively uneven performance on the test score changes 
and the four 3-month Follow-up outcomes. , SER participation Increased the 
likelihood that you would have a full-time job but the jobs were more 
likely to be of a low skilled category. However, SER participants, like 
Women's Bureau, did perform well on the positive activity index. 

With respect to the test measures themselves, additional evidence 
was gathered on their usefulness as a preliminary indicator of program 
success. That is, it was demonstrated that gains were significantly 
related to quality of employment, positive activity status, and to a 
lesser extent future Job aspirations. They (the test score gains) were 
not related to whether or not one was full-time employed three months 
after the program completion. While it was demonstrated that pre-post 
test Kfliu* were related to quality of Job placement, moot delivery agents 
didn't appear to bring about mean gains of sufficient magnitude o 
significantly Impact Job placement. 



It may be conjectured that certain urban communities are 
differentially capable with respect to supporting jobs for youth in 
either the low skilled categories and/or the semi-skilled categories. 
Delivery agents working in such communities could be expected to change 
test scores but the test score changes would be likely to have little 
impact on job placement criteria, especially af t* r a 3-month post high 
school period. In such communities, one would have to bring about larger 
mean score changes than were generally observed (say about .5 of a 
standard deviation) before one could expect to overcome the local community 
resistance with respect to job placement. RTP was the only delivery 
agent which consistently showed gains of this magnitude. 

It is further conjectured that the magnitude of gain must be in some 
sense proportionate to the availability of jobs to bring about the 
desired outcomes. That is, delivery age s in urban ghetto communities 
would have to bring about proportionately larger gains in order to bring 
about the same positive job placement outcomes as delivery ag*tits in lass 
resistant communities. The fact that our conclusions are based on 
participant-control group comparisons does not completely solve this 
problem in the sense that a particular community may only be physically 
able to accommodate 25% of the youth in full-time jobs, regardless of 
their attributes. In such a case, one would not expect that only three 
months after program completion the participants would have placements 
above the community's physical limits and/or above that of the control 
group. Conversely, communities that have the resources to enlarge the 
"employment pic M can absorb Increased numbers of adequately trained youth 
and are thus more likely to show proportionately more positive outcomes. 
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APPENDICES A-G 



APPENDICES A-G 
Summary Frequencies op Flow-Through of Students Tested 





All 
Programs 


USES 


NUL 


SER 


Women's 
Bureau 


NCNW 


RTP 


A. Participant Group 


N 


N 


N 


N 


N 


N 


s 


(1) Total pretested 


1755 


334 


472 


285 


207 


162 


279 


(2) Total pre- and posttested 


1043 


146 


333 


199 


140 


89 


136 


(3) Total pre-, and posttested 
with IPP's 


914 


138 


247 


172 


139 


82 


1 

136 


(4) Total pre- and posttested 
with IPP and Follow-up 


581 


110 


* 

81 


158 


77 


43 


i 

112 

J 


B, Control Group 
















(1) Total pretested 


1684 


291 


420 


282 


176 


195 


320 


(2) Total pre- and posttested 


991 


166 


248 


167 


100 


113 


197 | 


(3) Total pre- and posttested 
with IPP's 


863 


166 


144 


156 


92 


57 


197 | 


(4) Total pre- and posttested 
with IPP and Follow-up 


529 


111 


* 

24 


140 


32 


51 


m ! 



P2 V.ditlor-il «?.rtici-ant Follow-ir Surveys and 49 additional control Proun Follow-Un surveys were not originally 
kerunchw! bicnu.cn o : \r.it (after fleccribc: 27), Will be adfod tc in role Is analyses fer later Tf'eci 
report, 
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INSTRUCTIONS FOR APPENDICES A-G 

The tables in appendices A-G are used in the following way. If 
one wanted to know how many U.S. Employment Service participants have 
pre and post- test measures, one would sum the numbers in the last column 
of appendix A for those rows that have a yes in the treatment column 
and yes's in the pre-test and post-test columns. Following this rule 
we find that there are 5 + 3 + 28 + 110 85 146 U.S. Employment Service 
participants with pre and post-test measures. Sample counts can be 
estimated for any combination of measures. 
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APPENDIX A 

YCO IrJSTKUMl.ir CiUMIS 



U.S. LrlPLbYMl-NI SO'VIOE 



iKtATMhMI 


r»;a 1 LSI 


FMSTTEST 


I PP 


FPl I Pvi — IIP 


T LA J E J 


•Ml J 




NO 


MO 


in.' 


1 
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Ni: 


ill . 


M'j 




fro 


L 
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NfJ 


MP 


Mil 




Mi I 
IV • J 




\" ' 


NO 


YFS 


IE) 
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» v o 


Ml. 


YES 


MP 
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MP 


r\ 

.) 


N'J 




YES 


Nil 


Y t- C 


r\ 
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MM 


Ni I 


Y FS 


Yf 1 S 


MM 




Mr 


Mr 


YES 


YFS 


YPS 


1 7 


NO 


YES 


NO 




Mn 


;><♦ 


Nu 


Y^S 


MO 


NO 


YPS 
T L j 




MO 


y r s 


NO 


■ u O 


Kin 
1 4 ij 




[JO 


Y^S 


'^0 


YFS 


YFS 


*> 


NO 


V LS 


YES 




Mr. 


1 1 


NU 


YL'S 


YES 


f-J f 1 


YI' S 


A 

U 


NO 


YES 


YfS 


YES 


\)J i 
• j i.j 




MC 


YES 


YES 


VZ$ 


YFS 


111 
111 


YES 


Hv 


NO 


NU 


NO 


V/ 


YES ^ 


.40 


N'« 


MO 


YES 


0 


Yl : S 


MO 


NO 


YL'S 


NO 


2 


YES 


lJU 


MC 


* FS 


YES 


2 


YES 


•If 


YFS 


.MO 


MO 


I 


YES 


NO 


YES 


Nil 


Y5S 


0 


YES 


>iV 


YES 


YES 


NO 


I 


YES 


H:. 


YES 


YES 


YES 


5 


YES 


YES 


MO 


NO 


NO 


75 


YES 


YFS 


NO 


MfJ 


YES 


34 


YES 


YES 


MO 


y ? ;s 


NO 


44 


YES 


YES 


\0 


yes 


YES 


15 


YES 


YI : S 


YPS 


NO 


MC 


5 


YES 


YES 


YES 


no 


YES 


? 


YfS 


YFS 


YES 


Yt:S 


NO 


28 


YES 


Yf-i 


Yr" S 


YCS 


YES 


110 
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APPENDIX B 

YCO IMSl ?\\)Kt NT COUNTS 



NATIONAL U'T.AN I LAuUF 



TREATMENT 


P'-r. 1 EST 


PL ST TEST 




EOL LOW-UP 


* CASES 


NU 


IMP 


NO 


NO 


NO 


1 


no 


HO 


Mi' 


NO 


YES 


0 


NU 


N' ' 


Nil 


YES 


NO 


0 


Mi 


" 


MO 


YES 


YES 


0 


NO 


ni: 


YES 


NO 


NO 


5 


Nf 


Mi 


YES 


NO 


YES 


0 


m 


NO 


YES 


YES 


rin 


0 


Ml 


•10 


YES 


YES 


YES 


0 


NO 


YT-S 


NO 


NO 


NO 


172 


Nf, 


YES 


NO 


NO 


YES 


0 


NO 


YES 


MO 


YES 


NO 


0 


NO 


v »: s 


Nil 


YES 


YES 


0 


MD 


YES 


YES 


MP 


NO 


1 04 


Nil 


YL S 


YES 


NO 


YES 


0 


NO 


Y r.S 
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NO 
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NO 
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24 
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MO 


14 
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YES 


NO 


YES 
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APPENDIX C 

rco ir.'ST'-curnn cmumis 
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APPENDIX D 

YCD 1NSTPUMCHI COUNTS 
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APPENDIX E 
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APPENDIX 
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APPENDIX 

YCP INSUUM! Cl'lMI '> 

ALL PK'JuKA 'b uU.'f! I'll.;) 
TPEATMf.Nl f>K c T! ST i'USTJLST 
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APPENDICES H-N 



ERJC 



APPENDIX H 
U.S. EMPLOYMENT SERVICE 

'" Um tf,VU,V,CC '« -"'"P^l AND CONTRUl 0«C , C, ,, M ,SO,S 0, LHONTH FOUOW-UP 



-PAfillClPAdlS iiCMRlU. 



J*'" i ici-rr't no,? 

JUu MTU ? 

nu'uk < f i\r^.vie*w 

NU !>r u kAiSrS? 
FECI Ho AUo j i JUS? 
NU T VCHL L 



JtJRS? 



rurnvi? 

t PAY cXPfCrEO? 

*LA\S7 
Mjrf Ab'Vjr job? 
V c >'%jli M4UY7 
.AV ? 

( oi r? 

WHi! IS jiVI-Nj YUU A H\;.D TIME? 
H»i;<M\T Tj D'JT CF TROUBLE? 

FUT j-i jn-j TITLt? 
ACTlvlTf STAfJi (1) 



6MP L :,Y % rji 
HI.* fjii ; 

Mr;, fn^i 
oc y*; j i( jy 







AOJ. 


MEAN 


s.o. 


MEAN 


0.290 


0.454 


0.300 


2.369 


0.775 


2.307 


37.943 


4. on 


39.801 


9.000 


5,690 


6.021 


3,31* 


0.524 


1.253 


2.ur 


2.591 


2.162 


1.000 


1.134 


0.964 


0.523 


0.366 


0.511 


11.307 


2.41* 


11.362 


0.447 


C.49 7 


0.449 




2.326 


4.173 


1.552 


0.913 


1.519 


2.404 


0.645 


2.398 


14.519 


18.774 


19.083 


0.930 


0.255 


0.925 


1.220 


0.454 


1.214 


13.250 


0.912 


13.250 


2.904 


0,289 


2.902 


2.970 


0. 741 


2.966 


1.207 


0.723 


1.207 



MEAN 



0.3J5 
1.944 
40.222 
9.233 
3.654 
2.313 
1.241 
0,559 
11.30? 
0.529 
4.302 
1.468 
2.354 
24. 390 
0.900 
1.102 
13.374 
2.897 
2.857 
1.453 



S.O. 



0.46P 
0,941 
5.779 
6.174 
1.072 
2.789 
1.103 
0.8U 
2.195 
0.499 
1.654 
0.856 
0.656 
23.570 
0.300 
0.302 
0.877 
0. 305 
0. 769 
0.636 



ADJ. 
MEAN 



0.316 
2.006 

40.364 
9,412 
3.719 
2.297 
1.297 
0.576 

11.254 
0.527 
4.316 
1.500 
2.363 

23. 825 
0.905 
1.108 

13.374 
2.902 
2.861 
1.453 



COVARIANCE 
ADJUSTED 
EFFECT 



-0,035 
0.350 
-0.U4 
-0.093 
-0.583 
-0.050 
-0.315 
-0.077 
0.047 
-0.157 
-0.078 
0.023 
0.055 
-0.224 
0.069 
0.282 
-0.140 
0.002 
0.116 
-0.363 



-0,29 

3.38" 
-0.94 
-0.82 
-5,49" 
-0.42 
-2.72M 
-0.69 

0.39 
-1.29 
-0.77 

0.21 

0.45 
-1.97* 

0.56 

2,26» 
-1.14 

0.02 

1.14 
-3.00** 



i of- 4 a < i arie c r jn as tnur.*$i 



APPENDIX I 
NATIONAL URBAN LEAGUE 

V SI S Or CUVARIANCE ADJUSTED EFFECTS FOR PARTICIPANT A NO CONTROL GROUP COMPARISONS ON 3-MONTH FOLLOW-UP 



CQiURQLS. 



ME AN 



S.O. 



AOJ. 
MEAN 



MEAN 



S.O. 



AOJ. 
MEAN 



COVARIANCE 
AOJUSTEO 
EFFECT 



OMI'Jj F'JLL-TKE Mi:>? 0.27? 0.4*5 0.236 0.250 0.*33 0.286 -O.IK -0.*7 

Op T I TL e? 2.0*9 0.785 2.170 1.667 0.9*3 1.5** 0. 725 3.99*« 

OURS KUPKEJ PE^ *EU? *2.L*3 11.369 *0.9*b *0.000 0.0 *l.l96 -0.0** -0.05 

lUMrtfR WEEKS ON JOR? 9.309 5.511 8.913 2.667 0.*71 3.062 1.956 5.60** 

iTUWLY *Ajr? 3. 125 1.055 3.1B6 2.757 0.525 2.696 0.620 U.33** 

UMdLH APPLICATIONS FliX JC?S? *.053 *.86L 2.875 2.600 1.356 3. 778 -0.29L -1.53 

U^Ef Ur PlTr^IE-S? 1.68* 1.779 1.705 1.200 0.*00 1. 180 0.*82 l.*9 

I'JiMEP OF RAISES? 0.L05 0.307 -0.077 0.*00 0.800 0.532 -1. 190 

CELLOS AHO'JT J03? 10.513 2.028 10.3*9 9.800 2.088 9.965 0.187 0.82 

OV I*J SCHLJOL OH TRAINl\G? 0.*52 0.*S8 0.**2 0.333 0.*7l 0.3*3 0.20* 0.82 

MKLOYEO: HIGHEST PAY EXPECTED? 3.701 1.080 1.69* 3.537, 0.585 3.5** 0.180 0.*7 

MPLfiY^: SIX MCfJTH PLANS? 1.697 0.717 1.5*2 2.000 0.0 2. 155 -1.711 -*,5l** 

D» VJCH in YDU KMOh A9 r UT JOB? 2.*07 0.653 2.*25 2.133 0.699 2.315 0. 163 0.63 

0* rt'JC!* L'U YOJ GIVF YGUK FAMILY? 33.3*6 28.181 31.516 *0.000 10.000 *2.330 -0.566 -1.73 

lUh 0FTE4 DU Y-Jj SAVE? l.Oiu 0.0 1. 000 1.000 0.0 UOOO 0.0 0.0 

0 YUJ PJY CKEQIT? 1.156 0.363 1. 161 1.0*8 0.213 1.0*3 0.*07 U*7 

HC IS GIVING YJJ A HAFO TpE? 13.*70 0.781 13.*66 13.875 0.331 13. 879 -0.7** -2.29* 

MPiIRTA\T T ! J \EF!> HUT CF TROUBLE? 2.910 0.2(56 2.909 3.000 0.0 3.002 -0.6*9 -1.50 

UTJRE J^ 1 TITLE? 2.930 0.U56 2.976 3.077 0.828 3.031 -0.065 -0.21 

CTIVITY STATJS ID 1.253 0.789 1.186 1.167 0.687 1.232 -0.060 -0.26 



bSKlvri) VASU'ILE CC3EJ AS FOLLOWS: 

0 - NCVFR ,0*KED FULL TI*E OP PART TIME SINCE LEAVING THE PROGRAM, A NO NOT GOING TO SCHOOL 

1 = PREVIOUSLY jtMKn FULL TIME, OK WORKED PART TIME SMCF LEAVING THE PROGRAM, OR GJING TO SCHOOL PART TlMF 

2 = NOW rtURKlVi FULL TME, CR GOING TO SCHOOL FULL TI^E. OR OOING BOTH PART TIME 



ERIC 



APPENDIX J 
SCR JnBS FOR PROGRESS 

.YSIS UF CbVARUNCE ^JUSTHO EFFECTS FOR PARTICIPANT ANO CONTROL GROUP COMPARISONS ON 3-MONTH FOLLOH-UP 



£ASII£l£WI5 CQNIBQLS. 



bfKIV; FJLL-THc NUt? 
OH TIIL=? 

IHlhS rfORKtD ?t? 'rt E T K ? 
lUMt* WEEKS ON JOG? 

U*IH APPLICATIONS FC? JQAS? 
UMJEk ijr l^T^VIEhS? 
'JHtteK TF kAISGS? 

wines abcjt jon? 

01. I !>CMC:UL 'jP TRAINING? 
JVU'YE): H|OM£if PAY EXPECTED? 
M°L'jVfJ: SIX >uNTH PLANS? 

u* ucri nc rju know Aiwjt job? 

MJCH 00 YOJ -ilVE YRiiH FAMILY? 
UK GFTE.'J DO YOU SAVE? 

0 Y-JJ (jyy c: c*CUIT? 

HLl IS GIVING YOU A hARO TIME? 
4P;jR T A'lT TC KEEP OUT CF TPOUBLF? 
JTU-E JCS* TITLE? 
: T I VI TV STATUS (1) 



MEAN 



0.382 
2.579 

30.981 
9.0P0 
3.41b 
;.13d 
1.536 
0.509 

11.056 
0.587 
4.439 
1.468 
?. 301 

25.091 
0.891 
1.122 

13.572 
2.928 
3.031 
1.460 



s.o. 



0.486 
0.794 
5.513 
5.502 
0.589 
2. 801 
2. 500 
0.75? 
2.635 
0.492 
1.438 
0.877 
0.636 
22.563 
0.311 
0.350 
0.563 
0.283 
0.594 
0.659 



AOJ. 
MEAN 



0.380 
2.477 

39.191 
3.643 
3.569 
2.063 
1.357 
0.482 

11.033 
0.585 
4.625 
1.507 
2.333 

2 5. 725 
0.907 
1.164 

13.591 
2.909 
3.01* 
1.453 



MEAN 



0.309 
2.700 

41.625 
9.500 
3.639 
1.865 
1.15? 
0.522 

11.243 
0.506 
4.525 
1.432 
2.073 

23.416 

0. 949 

1. U2 
13.5*9 

2.910 
3.087 
1.213 



S.O. 



0.462 
0.728 
9.237 
5.025 
1.040 
3.481 
1.79 3 
0.3?7 
2.193 
0.500 
1.306 
0.902 
0.698 
22.245 
0.220 
0.334 
0.788 
0."*?6 
0.743 
0.800 



AOJ. 
MEAN 



0. 311 
2.902 

41.417 
9.857 
3.486 
1.940 

1. 330 
0.543 

11.216 
0.508 
4.389 
1.393 
2.041 

22. 731 
P.933 
1.070 

13.531 
2.928 
3.104 
1.220 



COVARIANCE 
AOJUSTEO 
EFFECT 



0.145 
-0.428 
-0.302 
-0.231 
0.103 
0.039 
0.013 
-0.034 
-0.055 
0.755 

o. r? 

0.i< - 
0.4.4 
0.131 
-0.099 
0.276 
0.088 
-0.063 
-0.135 
0.319 



1.21 
-3.84M 
-2.48* 
-1.R7 

1.11 

0.32 

0.10 
-0.69 
-0.44 

1.26 

1.53 

l<05 

3.68** 

1.09 

".82 
• M* 

a. 70 
-C. " 

-I 1/ 

?«*8** 



miViO VAPUbLC ClOEO AS FULLUWS: 

! * KlcK^uXo Jiu unTl^^^^^ * ND N0T G °'» G to SCHOOL 

* - full r,- E , Si So,g TdlJS. fV" niK"R l S!lf .SS ;ffi R !!« 0R G0ING ro SCH00L MRT "* 
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APPENDIX K 
HO 'EN'S B'JRE; J 

LYSIS CF CuVflo.UNCE ADJUSTED effects far participant and control group COMPARISONS ON 3-MONTH follow-up 



CQNIBULS- 



MEAN 



ADJ. 
HEAN 



MEAN 



S.D. 



AOJ. 
MEAN 



COVARIANCE 
ADJUSTED 
EFFECT 



»U^tS 1 *jG FJLL-TI'IE NfjX? o. 156 

ICfl TITLE? 2 . ? 86 

iCUr.S »rf,<EJ ?Ef; «:EK? 37. '.00 

WMrtt 3 a E t < S CN JOd? 9.3t>4 

WJklY W.\-;F.? 3.-U0 

AHHtCinLNS FCF JCbS? 2.WI 

UIV^ <ir PlTCRVIFwS? 1.333 

KU^^ ilF QAISESf 0.S45 

: EcL1^j \RCJT I0.94ti 

JUh' I "4 SCHfi r L 0* TRAINING? 0.6L2 

:mpluYCT: HIi'HESF PAY EXPFCTFD? 3.^08 

:MPL-Yfc.): SIX TJNIH PLANS? L.^7 

iU* MUCH 'G YO I KNCn / C'JUf JUe ? 2.3 70 

iC> '!JCi 00 Yl'J GlVf IHU1 FAMILY? 10.^*7 

10k HFTEN 00 YOU SAVE? 0.971 

)C YOU 3UV UN CREDIT? H26 

JHO IS G I V 1*4 j YIU A HACD TTMF? 13.275 

|MPCrTA\T TO KEC 3 G'JT (ir P:>J»LE? 2.978 

: UTU-.F J*t TITLE? 3. on 

iCTlVUY STATJS (1) 1.222 



0.3o2 
0.795 
4.005 
3.^45 
0.579 
2.796 
1.374 
0.656 
2.036 

o.Mr 

1.49b 
0.76? 
0.576 
lo.S56 
0.168 
0.332 
9.813 
0. US 
0.643 
0.711 



0. 232 
2. l7o 

36.938 
1 0. 365 
3.393 
3.092 

1 . 396 
0.628 

10.409 
0.719 
3.969 
1.774 
2.429 

10.394 

0. 985 

1. U4 
13.355 

2.965 
3.055 
1.483 



0.222 
1.875 

35.429 

14.286 
3.000 
6.125 
2.250 
0.333 

10.000 
0.441 
3.400' 
1.556 
2.333 
3.958 
1.000 
1.086 

13.339 
2.912 
2.742 
1.194 



0.416 
0.599 
4.37L 
6.776 
0.661 
5.988 
2.046 

0. 471 

1. 07 1 
0.497 
0.655 
0.831 
0.596 

20.915 
0.0 
O.2S0 
0.678 
0.284 
0.670 
0.810 



0.U6 
1.934 

35.891 

13.234 
2.912 
5.605 
2.187 
0.250 

10.539 
0.334 
3.240 
1.429 
2.274 
9.351 
0.986 
1.063 

13.308 
2.924 
2.701 
0.933 



0.221 
0.275 
0.250 

-0.571 
0.784 

-0.572 

-0.463 
0.671 

-0.066 
0.782 
0.681 
0.433 
0.264 
0.055 

-0.002 
0.245 
0.063 
0.188 
0.539 
0.723 



0.81 

4.92** 

1.11 
-5.90** 

3.29** 
-2.78** 
-2.14* 

3.B3** 
-0.19 

2.9L** 

1.93 

1.88 

0.96 

0.22 
-0.01 

0.84 

0.20 

0.77 

1.94 

2.89** 



3EftlV c U VAkUUE CHDED AS Frunws: 

0 = NhVLP. FJLL Tl'e LR PART TIME SINCE LEAVING THE PROGRAM, AND NOT GOING TO SCHOOL 

1 = PrEVHJJSLY NLXKEn FULl TME. U WORKED PART TIME SINCE LEAVING THE PROGRAM 9 OR GOING TO SCHOOL PART TINE 

2 * MOH rtKKI'lG FULL T|\E, Ok GUM TO SCHOOL FULL TIME. OR DOING BOTH PART TIME 



b3 
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APPENDIX L 
NATIfJNAL COUNCIL OF NEGPO WOMFN 
SIS UF CC^IAUE ADJJSTfO EFFECTS FOR PARTICIPANT ANO CONTROL GROUP COMPARISONS ON 3-HONFH FOLLOK-UP 



-EASIlClRiUIS 



- — CQUIBQLS. 



MEAN 



S.O. 



ADJ. 
MEAN 



MEAN 



S.O. 



AOJ. 
MEAN 



COVARIANCE 
AOJUSTED 
EFFECT 



KHG FJLL-TI'IE NC-,? 

nun 
frs ku^ED 'E- wnr.<? 

I*?* *SEKS 3N JO 5 )? 

?ei a*»li:atis,ns f:-> jms? 

UK «;F ^.'"VI^S? 

*cn lf ka:>es? 

LINGS AflCT JJ2? 

n sch'Ju^ c\ Tk;pji v;? 

LuVC*): HI v-iEST PAV :X»cCTcO? 
nYF.'J: St' 'T'lTH PH'JS? 

•tjr.-i ju fYJ -IIVE YOJ* FMILY? 

fiFT:., Oj fl[} SV/l? 
V^'J :.JY C CREDIT? 

IS Glvi:;5 YJ'j A ha 5 d TIME? 
i*T4'lT Tii <EE? OJT CF TaGJBL'? 
■Mc J'J^i TiTLC? 
IVITY STAT JS (1) 



0,113 
2.571 
37.125 
6.000 
3.666 
2.^)25 
2.000 

a. 125 

10. did 
0.750 
4.265 
1.600 
2.453 

10.091 
1. 000 
1.015 

13.726 
2. 958 
2.944 
1. 181 



0.316 
0.914 
3.407 
4.637 
0.806 
2.497 
1.291 
0.331 
2.t08 
0.433 
1.529 
0.800 
0.636 
22.444 
0.0 
0.121 
0.530 
0.201 
0.756 
0.5;5 



0.124 
2.669 

36.520 
6.168 
3.773 
2.403 
2.295 
0.128 

11.357 
0.735 
4.334 
1.475 
2.460 

19.662 
1.000 
1.016 

13.707 
2.971 
2.986 
1.217 



0.296 
2.214 

38.429 
8.200 
3.071 
1.750 
0.818 
0.077 

10.825 
0.722 
3.796 
1.688 
2.51? 

31.429 
I. 000 
1.042 

13.828 
3.000 
3.000 
1.393 



0.452 
0.860 
2.921 
3.655 
0.317 
2.165 
1.029 
0.266 
1.943 
0.448 
0.963 
0.583 
0.702 
29.392 
0.0 
0.200 
0.378 
0.0 
0.568 
0.646 



0.2 74 
2.117 

39.034 
8.032 
2.964 
1.97^ 
0.523 
0.073 

10.286 
0.733 
3.728 
1.813 
2.508 

30.857 
1. 000 
1.040 

13.846 
2.987 
2.958 
1.356 



-0.391 
0.625 
-0.794 
-0.450 
1.443 
0.185 
1.528 
0.184 
0.516 
-0.007 
0.486 
-0.489 
-0.072 
-0.523 

0.0 
-0.148 
-0.306 
-0.166 
0.042 
-0.225 



-1.92 

4.09*» 
-10.46** 
-2.49* 



12.54** 

1.18 

3.86** 

0.09 

5.21** 
-3.73** 
-0.30 
-2.45* 

-0.82 
-1.45 
-0.53 
0.18 
-1.08 



0> 
O 



WHJ VAI'IAHEJX}*; AS FOLLOWS: 

i n^-^n^n I HE ' JR PAPT THE SIKCC LEAVING THE PROGRAM. AND NOT GOING TO SCHOOL 



9 
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APPENDIX M 
RECRUITMENT AND TRAINING PROGRAMS 
ILYSIS ■> CC/AP I ANCE AOJJSTED EFFECTS FfjR PARTICIPANT ANO CONTROL GROUP COMPARISONS ON 3-MONTH FOLLOW-UP 



.milUJB^IS LuNIEDLS. 



MEAN 



S.D. 



AOJ. 
MEAN 



MEAN 



S.O. 



ADJ. 
MEAN 



COVARUNCE 
ADJUSTED 
EFFECT 



WGF.sU; F'JLL-TIHF Ml.,,? 
JJO TITLE? 

HOU^S V»C^<E J PE C . H£U? 
W-,t ft >» c cKS ON JOB? 
HUJUY ia;fc? 

NU ,, ;7* WPLICATirNS FT* JC6S? 
Mr'".:* cF IMtcviFi-S? 

w;i>:-< :r ^iscs? 

FfcEcI .;S i3i-JT JUS? 

NCh n iCH^CL "? % TRA . Nl*'j? 

EMPLOYED: HIGHEST PM Jx^tCTEO? 

E^L-.Yej: Sl« 40NTH PLANS? 

HZ'* HJO jo *OU KKw'^ A3CUT joe? 

H'N vjch nr. yr.j ;| V e y-j* FfiM ILY? 

HOV CrH i JC YCJ S4/£? 

00 Y r „j oJY Ci « C^ c f:IT? 

hHL IS OIVIMS YCU A nWj THE? 

IMPCUA^T TT Kit? HUT OF TROUBLE? 

futj-.e . TITLE? 

ACT I VI IY Sr/.TJS (I) 



0.162 
2.303 

38.b90 

11.036 
3.281 
4.424 
1.719 
0.500 

10.422 
0.53b 
4.407 
1. 740 
2.201 

I 2. 877 
0.9S3 
1.095 

13.383 
2.957 
2.942 
1.233 



0.386 
1.029 
3.131 
5.949 
0.590 
4.793 
2.035 
0.764 
2.240 
0.492 
1.231 
0.658 
0.655 
13.654 
0.212 
0.279 
0.562 
0.2C4 
0.734 
0.700 



0.193 
2.329 

38.733 

11.089 
3.290 
4.257 
1.742 
0.494 

10.467 
0.595 
4.485 
1.713 
2.229 

12.297 
0.953 
1.0H7 

13.371 
2.959 
2.847 
1.251 



0.147 
2.120 

40.455 
8.889 
3. "54 
3.652 
1.190 
0.435 

10.990 
0.640 
4.419. 
1.471 
2.001 

10.278 
0.897 
1.049 

13.415 
2.944 
2.838 
1.203 



0.354 
0.816 
7. 30 j 
5.301 
C.626 
2.913 
1.096 
0.648 
2.492 
0.480 
1.416 
0.848 
0.619 
16.844 
0.305 
0.243 
0.552 
0.229 
0.815 
0.658 



0.136 
2.094 

40.411 
8.835 
3.345 
3.820 
1.167 
0.441 

10.945 
0.632 
4.341 
1.497 
2.054 

10.858 
0.896 
1.047 

13.426 
2.942 
2.834 
1.185 



0.153 
0.255 

-0.322 
0.401 

-0.090 
0.113 
0.367 
0.076 

-0.202 

-0.075 
0.107 
0.286 
0.275 
0.081 
0.219 
0.151 

-0.097 
0.074 
0.017 
0.098 



1.49 

2.49* 
-3.00** 

4.03** 
-1.25 

1.37 

3.31** 

0.72 
-1.99* 
-0.74 

1.13 

2.90** 

2.71** 

0.79 

2.14* 

1.46 
-0.95 

0.72 

0.17 

1. 00 



H 



OJMvP-) VAkUHF ccjeo as FOLLOWS: 

0 = \'CVEK r.CKEJ F'JLL I ME DR PART TPF SINCE LEAVING THE PROGRAM, AND NOT GOING TO SCHOOL 

1 = P'-tVluJSLY WUr'KE: FULL TIME, UR n'CRKEli PART TIME SINCE LEAVING THE PROGRAM. OR GC1NG TO SCHOOL PART TIME 

2 » JO KO-Vl'6 FJLL TJmf, 0k GOING TO SCHOOL FULL 7 1 ME t OR DOING BOTH PAPT TIME 



3 



ERIC 



APPENDIX N 
ALL PROGRAMS COMBINED 

MS Uf CGVi'MANCe AOJUST6D EFFECTS FOR PARTICIPANT A NO CUNTROL GROUP COMPARISONS ON 3-MONTH FOLLOW-UP 



.EAailCIEAUIS. 



-CflHIAQLS 



MEAN 



S.O. 



AOJ. 
MEAN 



MEAN 



S.O. 



AOJ. 
MEAN 



COVARUNCE 
AOJUSTEO 
EFFECT 



r;j f jLL-r r»F uru? 0.2^6 

3 W„''.<EJ ?L p . WCl<? 39.360 
■E'< «llKS JM J'J^.? 9.315 
LY 3,337 
= • AP.JLCATl.rjS FO.< JCr5? 2.A73 
= P. wF INTc^vicuS" 1.497 
TF I 5 f 5? 0.447 

l.jl AIm.JT JO*? 10.894 

i-i s:mii.l op mnr.;? o.S65 

■JftJ: HH.tEST PAY t<t>ECTE07 4.216 
r/:): Six i C , NTH PLANS? 1.596 
• Vi /',U KNU'v, A J OUT JOB? 2.335 

ifc y;u give your family? 19.322 

rJFTE j 0;. rn-J SAVE? o.94( 
:j CKEDIT? 1.123 

M jtVJNG YD J A HA? D TIME? 13.427 
y TV'T TP <FEr J OUT CF TROUBLE? 2.939 
*t JQ=1 TITLE? 2.9S3 
vUr SIATJS (LI 1.273 



0.430 
0.362 
6.039 
5.616 
0.675 
3.646 
2.017 
0.738 
2.373 
0.496 
1.532 
0.794 
0.642 
22.064 
0.226 
0.3'.3 



,720 
,245 
7L3 
705 



0.255 
2. 389 

39.42Q 
9.524 
3.397 
2.913 
1.432 
0.460 

10.935 
0.565 
4.286 
1.579 
2.345 

18.991 
0.950 
1.13L 

13.433 
2.938 
2.956 
1.288 



0.251 
2.259 

40.316 
9.310 
3.471 
2.561 
t. 225 
0.457 

11.048 
0.565 
4.311 
1.495 
2. 199 

20.361 
0,935 
1.080 

13.500 
2.930 
2.92 7 
1.274 



0.434 
0.8V2 
7.268 
5.638 
0.944 
3.471 
1.466 
0.750 
2.254 
0.496 
1.417 
0.846 
0.676 
22.513 
0.247 
0.265 
0.709 
0.268 
0.769 
0.715 



0.242 
2.258 

40.247 
9.101 
3.4U 
2.521 
1.240 
0.443 

11.007 
0.565 
4.242 
1.512 
2.189 

20.692 
0.930 
1.073 

13.495 
2.931 
2.923 
1.259 



0.030 
0.149 

-0.123 
0.075 

-0.017 
O.tiO 
0.139 
0.023 

-0.C31 

-0.001 
0.030 
0.082 
0.237 

-0.076 
0.085 
0.185 

-0.087 
0.027 
0.044 
0.040 



0.56 

-2.30* 

1.37 
-0.40 

2.33* 

2.45* 

0.41 
-0.56 
-0.02 

0.59 

1.50 

4.37" 
-1.44 

1.55 

3.37" 
-1.59 

0.49 

0,80 

0.75 



Ef ivn VA'mSLE CO^ED AS FOLLOWS: 

C = NEVER n;,«<EO rJLL THE OR PART T I M Ci SINCE LEAVING THE PROGRAM, ANO NOT GOING TO SCHOOL 

1 = P^VJUSLY rfCPKfJ FULL TIME » OP KURKEO PART TIME SINCE LEAVING THE PROGRAM t OR GOING TO SCHOOL PART TIME 

2 * W WftKlHO FULL THE, UR GOING TU SCHOOL FULL TIME, OR OUING 80TH PART TiME 
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Sequence of Instrument Administration 
for In-School or Summer-Only Programs 





Duiing First 
Week of Program 


At Exit From (or 
End of) Proaram 


Three Months"* 
After Exit 
From Program 


Eight Months 
After Exit 
From Program 


Those who remain in 
program for less than 
10 program days 


.Participant' s 
Characteristics- 
(IPP) 
STEP 

Pretests 


.Program Status- 
(IPP) 


•Program 
Follow -Up 
Survey 


•Program 
Follow-Up 
Survey 


Those who remain in 
program for 10 or more 
program days, but less 
than 60 program hours 


.Participant's 
Characteristics- 
(IPP) 
STEP 

Pretests 


.Program Status- 
(IPP) 1 
Posttests 


•Program 
Fol low-Up 
Survey 


•Program 
Follow-Up 
Survey 


Those who remain in 
program for 60 or 
more program hours 


.Participant's 
Charact€:ristics- 
(IPP) 
STEP 


.Program Status- 
(IPP) 1 
Posttests 

Program Completion 


•Program 
Fol low-Up 
Survey 


•Program 
Follow-Up 
Survey 


4 

Control Group 


.Participant's 


2 

•Posttests 


•Control 


•Control 



Characteristics- Control Group Group Group 

(IPP) Status 2 Follow-Up Follow-Up 

STEP Survey Survey Survey 
Pretests 



If you can determine when a participant will leave the program, test in last 2 weeks 
prior to leaving* If the youth leaves before testing has taken place, locate youth for 
testing and, if necessary, pay youth $5.00 to complete testing (this includes both the 
Posttests and the Program Completion Survey, if required). 

2 

Date set in consultation with ETS staff. 

3 

Pay $5.00 to each youth who completes the 3 month Follow-Up Survey. 

A 

If necessary, you may pay control group youth for participating testing. $5.00 for 
Pretests, and $5.00 for Posttests and Control Group Status Survey. 

NOTE: YCD Demonstration Project requires post testing for any youth who has been in the 
program for 60 or more program hours. 
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APPENDIX Q 



Occupational Status Scale Coding 



Level 5 

High Level Professional and Technical— (p.p. r Physician, Dentist, Physical 
Scientist, Engineer, College or University Professor, Librarian, Pharmacist) 



Level 4 

Technical. Manageri al and Administrative; Middle Level Prof essional- -(e. 
Engineering and Science Technicans, Social and Welfare Worker, Nurse, 
Surveyor, Police Officer, Detective or Sheriff, Office Manager, Computer 
Programmer) 



Level 3 

Clerical, Crafts an d Kindred— (e.g. , Sales Clerk or Salesperson, Bank 
Teller, Brickmanson, Plumber, Welder, Bookkeeper, Secretary, Tool and Dye 
Maker, Tailor, Dental Assistant) 



Level 2 

Service Workers: Lo wer Level Crafts and Operatives— (e.g. . Bottling and 
Canning Worker, Seamstress, Fork Lift Operator, Sailor and Deck Hand, 
Watchman, Waiter, Waitress, factory Assemblers, Meat Cutters) 



Level 1 

Laborers and Low-Le vel Service Workers— (e.g. . Freight Handler, Garbage 
Collector, Carwasher or Equipment Cleaner, Farm or General Laborers, 
Busboy, Dishwasher, Baggage Porter or Bellhop) 




APPENDIX R 



PARTICIPANT - CONTROL SUBGROUP COMPARISONS 
WITH RESPECT TO 
SELECTED 3-MONTH FOLLOW-UP OUTCOMES 
for 

US EMPLOYMENT SRRVICE 

(In Percentages)* 

PARTICIPANTS CONTROLS 

Probability of Probability of Probability of Probability of Probability 0 f Probability of"^obIbilitv of Prah*hm*v «f 

SsT' BB? Eft- Ki ~ ™"'' sS-1 s S ., 

Full Time Semi-Skilled Skilled Job to School Full- Full-Time Semi-Sklllcd Skilled Job to School Full" 

tlme ° r Belng Job time or Beint 

. Both Part-time ™ ? r f e J? 8 

- Both Part-time 



.34 
.26 



.47 
.61 



.83 
.86 



.52 
.50 



.47 
.24 



.11 
.61 



.64 
.84 



.80 
.60 



.25 
.41 



.56 
.50 



.81 
.96 



.47 
.65 



.28 
.41 



.30 
.50 



.78 
.83 



.67 
.67 



.33 
.25 
.10 



.37 
.73 
1.0 



.86 
.81 
1.0 



.51 
.44 
.60 



.28 
.18 
.33 



.18 
.33 
1.0 



.69 
.87 
1.0 



.66 
.53 
.67 



.29 



.30 



.57 



.33 



.84 



1.0 



.50 



.58 



.33 
.22 



.32 



1.0 



.79 
.75 



.67 



.70 



.26 
.32 



.60 
.50 



.82 
.87 



.44 
.56 



.24 
.42 



.42 
.35 



.73 
.85 



.61 
.72 



.32 



.49 



.81 



•51 .32 .33 .77 

in this table are probabilities which were not adjusted for pre-existing differences between groups and demographics. 
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APPENDIX S 

PARTICIPANT - CONTROL SUBGROUP COKPARISIONS 
WITH RESPECT TO 
SELECTED 3-MONTH FOLLOW-UP OUTCOMES 
for 



CONTROLS 



NATIONAL URBAN LEAGUE 

(In Percentages)* 

PARTICIPANTS 

Probability of Probability of Probability of Probability of ProbaMlity of Probability of Probability of Probability of 

Being Presently Being Presently Aspiring to Being Employed Being Presently Being Presently Aspiring to Being Employed 

Employed In Skilled or Skilled or Semi- Full-time, Going Employed in Skilled or Skilled or Semi- Full-time, Going 

Skilled Job to School Full- Full-Tlrae Semi-Skilled Skilled Job to School Full- 



Full-Time 



Semi-Skilled 
Job 



time or Being 
Both Part-time 



Job 



time or Being 





.27 


.10 


.76 


.69 


.50 


.40 


.33 


.70 




.28 


.55 


.75 


.46 


.07 


0.0 


.90 


.29 


White 
e 


.28 
0.0 


.33 


.75 
1.0 


.59 
O.O 


.29 
0.0 


.33 


.75 
1.0 


.43 
.<7 


IC STATUS: 


















LLSIL 
5Z LLSIL 
or more 


.27 
.20 
.40 


.39 
0.0 
0.0 


.76 
.60 
1.0 


.58 
.40 
.80 


.32 
0.0 


.33 


.70 


.37 
0.0 


MENT PRIOR 

CD: 


















oyment 


.29 


.28 


.76 


.65 


.28 


.40 


.67 


.56 


rior 
oyment 


.18 


.67 


.73 


.29 


.17 


0.0 


1.0 


.17 


US CETA 
ICIPATION: 


















ES 
0 


.25 
.29 


.50 
.27 


.94 
.69 


.63 
.57 


.33 
.23 


1.0 
0,0 


1.0 
.71 


.33 
.46 




.27 


.33 


.75 


.58 


.25 


.33 


.7; 


•46 



c 



es in this table are probabilities which were not adjusted for pre-existing differences between groups and demographics. 
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participant - control subgroup comparisons 
with respect to 
selected 3-month follow-up outcomes 



(In Percentages)* 
PARTICIPANTS 

Probability of Probability of Probability of 
Being Presently Being Presently Aspiring to 
Employed in skilled or Skilled or semi 

Full-Time Semi-Skilled Skilled Job 

Job 



for 

SER-JOB FOR PROGRESS 

CONTROLS 

Probability of Probability of Probability of~pTobability of Probability of 

«n t ™ Z L T'? T mtly Belng pre8ently t0 «•£ S oy 

Full-time, Going Employed i„ Sltl i led or skllled „ rM UZ, Going 



to School Full 
time or Being 
_Both Part-time 



Full-Time 



Semi-Skilled 
Job 



Skilled Job 



to School Full- 
time or Being 
Both Part-time 



le. in thia table are probabilities which were not adjusted for pre-existing difference, between 



groups and demographics. 



APPENDIX U 



PARVICIPAITC - CONTROL SUBGROUP COMPARISONS 
WITH RESPECT TO 
SELECTED 3-MONTH FOILOV-UP OUTCOMES 
for 

WOMEN'S BUREAU 

(In Percentages)* 
PARTICIPANTS 

Probability of Probability of Probability of Probability of 
Being Presently Being Prestit ly Aspiring to Being Employed 
Employed In Skilled »r Skilled or seal- Full-tine, Going Employed 
Full-Time Semi-Skills Skilled Job to School Full- Full-Tim 
Job — ■ time or Being 
. Both Part-time 



CONTROLS 

Probability of Probability of Probability of 
Being Presently Being Presently Aspiring to 

In Skilled or Skilled or seni- 
Seml-Skilled Skilled Job 
Job 



Probability of 
Being Employed 
Full-time, Going 
to School Full- 
time or Being 
Both Part-time 



.16 



.50 



.56 



.22 



.13 



.66 



.58 



.06 
.31 



.80 

.33 



.92 
.79 



.A3 
.63 



.31 
.15 



• 20 
0.0 



.47 
.68 



.38 
.75 



.12 
.33 
.50 



.67 
0.0 
1.0 



.91 
.66 
1.0 



.53 
.70 
1.0 



0.0 
0.0 
.32 



0.0 



.56 
1.0 
.65 



.11 
0.0 
.90 



.33 
.05 



.36 



1.0 



.62 



.92 



.62 



.41 



.17 



.28 



0.0 



.20 



.86 
.53 



.83 
.33 



.06 
.18 



0.0 
.54 



.86 
.91 



.81 
• 53 



0.0 
.24 



.13 



1.0 
.67 



0.0 

.54 



.17 .50 .88 .56 .24 .11 .66 

ii In this tible ari probabilities which vera not adjusted for pre-existing differences betwsen groups and demogrsphlcs. 
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APPENDIX V 



PARTICIPANT - CONTROL SUBGROUP COMPARISONS 
WITH RESPECT TO 
SELECTED 3-MONTH FOLLOV-UP OUTCOMES 
for 

, T n 4 NATIONAL COUNC IL OP NEGRO WOMEN 

(In Percentages)* 
PART I CI PAN TS 

Probability of Probablllty~ol Probability of ProhaMH^ n f o l u.,, CONTROLS 

sm-" rasr saL. S , 

Both Part-time 



Probability of 
Being Employed 
Full-time, Going 
to School Full- 
time or Being 
Both Part-tlm* 



.15 
.06 



.25 
1.0 



.81 
.75 



.83 
.79 



.42 
.22 



.33 
.38 



1.0 
.79 



.85 

.76 



.11 



.06 
.11 
.14 



.57 



.AO 
1.0 



.77 



.71 
.78 
.75 



.82 



.92 
.60 
1.0 



.23 
.50 



0.0 
0.0 
.50 



.27 
.50 



0.0 



.62 
1.0 



.67 
.75 
1.0 



.78 
.66 



1.0 
.50 
.50 



.11 



.11 



.33 
.75 



.93 
.72 



.75 
.64 



.32 
.24 



.44 
.20 



.77 



*69 



.84 

.73 



.10 
.12 



0.0 
• 80 



.66 
.78 



.76 
.66 



.18 
.28 



.33 
.44 



.57 
.91 



.82 
.81 



' 10 M ' -S3 , 25 , J6 

■ m ehl . a* iri probiblllelM vhlch wn not idJuittd ^ pr _ itting diffirwcM ^ ^ ^ ^ 



.87 



.74 
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PARTICIPANT - CONTROL SUBGROUP COMPARISONS 



WITH RESPECT TO 
SELECTED 3-MONTH FOLLOW-UP OUTCOMES 
for 

RECRUITMENT AND TRAINING PROGRAM 

(In Percentages) * 

P ARTICIPANTS 

Probability of Probability^ Probability of 
Being Preeently Being Presently Aspiring to 
Employed In Skilled or Skilled or seal 

Full-Time Semi-skilled Skilled Job 

Job 



Probability of Probability of 
Being Employed Being Presently 
Full-tlae, Going Employed 
to School Full- Full-Tlme 
tine or Being 
Both Psrt-tlma 



CONTROLS 

Probability of Probability of Probability of 
Being Presently Aspiring to Being Employed 
In Skilled or Skilled or seal- Full-time, Going 
Semi-Skilled Skilled Job to School Full- 
Job time or Being 
Both Pert-time 



.23 
.15 



.25 
.47 



.70 
.70 



.66 
.62 



.23 
.09 



.40 
.20 



.62 
.73 



.80 
.63 



.17 
.31 



.26 
.BO 



.68 
.62 



.64 
.63 



.12 
.27 



.33 
.30 



.67 
.76 



.66 
.83 



/10 
.28 
.11 



.42 
.30 
.33 



.68 
.70 
.69 



.69 
.73 
.36 



.09 
.13 
.22 



.13 
.33 
.46 



.73 
.73 
.60 



.64 
.91 
.74 



.20 
.16 



.43 
.23 



.71 
.69 



,66 



.61 



.16 



.33 



.23 



.68 
.72 



.71 
.70 



.19 
.18 



.60 
.33 



.80 
.69 



.77 
.63 



.07 
.15 



1.0 
.26 



.B0 
.69 



.60 
.71 



LS .17 .36 .68 .62 .13 .33 

rise in this table are probabilities which vers not sdjustsd for prs-sxlstlng differences between groups and damogrsphics. 

L 



.71 



.70 
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APPENDICES X-l to X-7 



Appendix X-l 



U.S. E-tPLUYMFNT SERVICE 

f. U CUVARUNCL ADJUSTED EFFECTS Ft)K P A r T I C I PANT A NO CONPUl GROUP COMPARISONS ON 3-MONTH F0L10K-UP 

WITH ADJUSTMENTS FOR BIAS 

EA£1ICIEAUIS__ CDNIBDLS 



ADJ. 

"liAM S.O. MEAN MEAN S.O. MEAN 



COVARIANCE 
AOJ. ADJUSTED 

EFFECT T 





0.^0 


0.4$4 


0.299 


0.125 


0.463 


0.316 


-0.037 


-0.31 




2.368 


0.775 


2.2«5 


l.P'*4 


3.941 


2.01 H 


0.323 


3.13** 


OUAUT> IO'L'iW, leiilJH) 


0.513 


0.500 




0.389 


0.487 


0.395 


0.226 


2.14* 


vS ..PI KI .J prK WEEK? 


39. >43 


4.077 


39.72s 


40.2*2 


5.779 


40.440 


-0.145 


-1.20 


!ti; hCEKi Oil JW 


^.000 


5.fJV0 


a. 723 


9.2^3 


6.174 


9.505 


-0.12* 


-1.08 


Lf f.W? 


3. ilH 


0.524 


3.237 


1.654 


1.072 


3.735 


-0.624 


-5.94** 


tf.r Ai'PUC.AUl.NS HI? JlHiS? 


2.L47 


2.5*1 


2. 13S 


2.313 


2.789 


2.325 


-0.071 


-0.59 


il-i! INTEkVIFUS? 


I. '100 


L134 


0.945 


1.241 


1.103 


1.296 


-0.314 


-2.69** 


ul R.MSCS? 


o.5;h 


0.8'>6 


0.508 


0.559 


0.811 


0.579 


-0.0 B5 


-0.76 




11.307 


2.41* 


11.372 


11.304 


2.185 


11.243 


0.056 


0.*6 


!•) SCiUia TEAIU'tG? 


0.'»47 


0.497 


0.451 


0.5?«5 


0.4*9 


0.524 


-0.147 


-1.20 


.jYt.il HIOHl'ST PW EXPECTED? 




2.02l> 


'i.U7 


4.302 


1.65* 


4.321 


-0.004 


-0.83 


.JYlJ: 3I'< Mu'lIU PLAfIS? 


1.552 


0 . rf 1 3 


1.513 


1.46* 


0.8'i6 


1.506 


0.001 


0.08 


AMI ..'C Yli'J KWw Aul'JT JOH? 




0.M5 


2.403 


2.3 r >4 


0.6 r '6 


2.358 


0.069 


0.56 


HUC'i M< YOU liiVi: YMIjp MilLY? 




ia.77'» 


19.376 


24.390 


23.570 


23.532 


-0.1*6 


-i,73 


uniN P:J VIUI SUE? 




0.>55 


0.9*7 


0.900 


0.300 


0.904 


0.083 


0.69 


ft j *uy Gi chut? 


1.220 


0.404 


1.212 


1.102 


0.302 


l.UO 


0.270 


2.15* 


iS tilViNi YuU * HAPO T1"E? 


13.250 


0.912 


13.262 


13.374 


0.877 


13.362 


-0.113 


-0.92 


i'-lASf 1, Klf-P lMI OF TPUIPLL'? 


2. "04 


0.2H9 


2.890 


2.P'i7 


0.395 


2.<>06 


-0.025 


-0.20 


IW JU 1 TlTLt:? 


?.970 


o. m 


2.960 


2.357 


0.769 


2.867 


0.122 


1.00 


JlH OUUITY (0-Ll».f t 1 = HIGM 


0.' f >0 


0.357 


0.B37 


0.7iih 


0.4)0 


0.799 


0. 100 1 


0.U4 


1 VI W *TA1U> III 


1.352 


0.766 


1.357 


1.609 


0.628 


1.604 


-0.354 


-2.91** 


IVMY fJAIUS (?) |PFC%!iD| 


0.531 


0. 


0.532 


0.6PB 


0.4K 


0.6H6 


-0.320 


-2.63** 



'.UFO VAilltBLC COOF'J AS FflLL^WS: 

* MVr;< r ;n;KLO FULL THE <IP PA*T TIME SINCE LEAVING 1HE PROGRAM, AMD MOT GOING TO SCHOOL 

» P„tVm!JSLY Khl.kL'j FULL TMF, [}% PAPT T IMF SINCE LEAVING THE PROGRAM OR GOING TO SCHOOL PART TIME 

« fl'-W UV'tm, I JI.L TlrtF, UK GDIUO TU SCHLMIL FULL T I M F • OP DOING ROTH PART TIME 

JlflG f«F ACTIVITY STAIUS (lit 

» Mfi FNl'. W* v I'OMTIVF ACTIVITY Ni»W ISAMF AS 0 ♦ I AM1VE) 
■ HILL U 4 L i > i<SIUVr ACT IVMY (lAilf: AS 2 A10VE) 
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Appendix X-2 



NAT I UN A L URBAN LEAGUE 



— eakiiulanis 



-CDfcLLBCLS„ 



F'JLL-TI MC TO? 
U TITLE? 

r; ju-uitv tonuwt i=high) 

MS W'j«KiJ PFn WEEK? 
M'*fc*i< 'UEKS ON JUcl? 
UHIY WAGL7 

WR AP«>L I CATIONS FOR JfiOS? 
lats (IF IN'TEFVIFhS? 
HrfE'% OF RAISES? 
EUHOb AiKJUT JOB? 

ft pi scrir.i-L t jk training? 

>L'jYFJ: HIGHEST PAY PXPECTCD? 

'luyf.di su mwth plans? 

x MUCH UU YOU KNOW ARUUT JOr<? 

MUCH OU YUU GJVt YUUP FAMILY? 

OFtFN Oh YuU SAVE? 
YOU CUY UN CiiEDIT? 
J IS GIVING YuU 4 HAND TIUC? 
WANT TU KEEP UUT UF TkOUULE? 

»j«e jon iitlf? 

URI J(M» QUALITY (0«LOM, I -HIGH 

IV1TY STATUS (1) 

IV1TY STATUS (21 (RECODEO) 



MEAN 



0.272 
2.048 
0.368 

42.143 
0.308 
1.125 
4.053 
1.684 
0.105 

10.513 
0.452 
3.701 
1.097 
2.407 

33.S46 
1. 000 
1.156 

13.470 
7.910 
2.930 
0.754 
l.3bl 
0.578 



S.D. 



0.445 
0.785 
0.482 
11.369 
5.511 
I. OSS 
4. Ml 
1.779 
0.307 
2.028 
0.408 
1. 000 
0.717 
0.653 
28.181 
0.0 
0.363 
0.7UI 
0.2H6 
0.856 
0.430 
0.815 
0.494 



ADJ. 
MEAN 



0.238 
2.171 
0.379 

40.959 
3.923 
3.189 
2.877 
1.706 

-0.074 

10.354 
0.445 
3.693 
1.541 
2.434 

31.577 
U)00 
1.162 

13.478 
2.913 
2.976 
0.779 
1.336 
0.553 



MEAN 



0.250 
1.667 
0.18? 
40.000 
2.667 
2.757 
2.600 
1.200 
0.400 

9.eoo 

0.333 
3.537 
2.000 
2.333 

40.000 
1. 000 
1.048 

13.875 
3.000 
3.077 
0.769 
1.292 
0.458 



S.D. 



0.433 
0.943 
0.3H6 
0.0 
0.471 
0.525 
1.356 
0.400 
0.800 
2.088 
0.471 
0.585 
0.0 
0.699 
10.000 
0.0 
0.213 
0.331 
0.0 
0.828 
0.421 
0.735 
0.498 



ADJ. 
MFAN 



0.284 
1.543 
0.171 

41.183 
3.047 
2.693 
3.776 
1.178 
0.580 
9.959 
0.340 
3.54b 
7.156 
2.307 

42.270 
1.000 
1.042 

13.867 
2.998 
3.031 
0.744 
1.317 
0.483 



COVARJANCE 
ADJUSTED 
EFFECT 



-0.104 
0.726 
0.479 

-0.039 
1.966 
0.628 

-0.289 
0.494 

-1.102 
0.192 
0.216 
0.176 

-1.714 
0.188 

-0.560 
0.0 
0.4L8 

-0.701 

-0.595 

-0.06ft 
0.083 ' 
0.025 
0.141 



-0*43 

3.97** 

1.65 
-0.04 

5.60** 
11.99** 
-1.51 

1.49 

1.49 

0.84 

0.86 

0.46 
-4.48** 

0.75 
-1.70 
-1.70 

1.50 
-2.24* 
-1.42 
-0.21 
0.33 
O.lt 
0.60 



R1VFD V API ABLE CODED AS FOLLOWS I 

■ now wuKKiNj fU u me, ofSi! fS ^;«I/*T«S}! ,c i l S!M Z?^, m C0,NG T0 SCH00L PART " HE 

OtfIS OF ACTIVITY STATUS (Hi 

" S!!,f U iLI ,n ACTIVITY HUM (SAME AS 0 ♦ I ABOVE) 

• FUU TIME POSITIVE ACTIVITY (SANE Aj 2 ABOVE) 
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Appendix X-3 



SLR JUflS FUR PROGRESS 

SIS of C(JVA«IANCC ADJUSTED ErFtCTS FUR PARTICIPANT AND CONTROL GROUP CflMPAAlSTMS ON 3-MDNTH FOLLDW-UP 

WITH ADJUSTMENTS FOR BIAS 

mucdmis 



.CQNIifOLS. 



ADJ. 



MEAN S.O. MEAN MEAN S.D. MEAN 



COVAK1ANCE 
ADJ. ADJUSTED 



EFFECT 



wing full-tpf ng/i? 

L) TITLE? 

;i v UUTY |(i»LOW, IslllGHl 



J'l t 



..I 1 ro (=iJ J'Jti? 
, A .1 r 

Ar^LIlATIUhS fOf JUUS? 
( iT 1MIFKMEWS? 

ihck uists? 

E-U^ba \M'JT J"li? 

I'l SLMO'JL Ok TPAINIM3? 
i*L f iVLul Ml >McST P*Y UP?CTEU? 
PLOVfDl biX M'nTH PL A'JS? 
K rlUUi Cu YUU KUOH AH' JUT Jl,,'1? 

ii much 01.; vuu oi vr yijuo fairly? 

OFTEN i)0 Y')U S*VI:? 
YOU IVJY CftEUIT? 
J IS G I V I No YUU A HAhO TIME? 
M-'K I A 'IT 7 f J KELP UUT UF TROUBLE? 
fJRL Jil'1 THL?? 

UM. Jl.1 JJALIIY (OUUWi LEHIGH 

IIVITY STATUS U) 

IIVIIY STATUS (RCCUREM 



0.332 

2.579 
0.A71 
3H.983 
9.100 

?.m 

1.536 
0.500 
11.056 
0.5&7 
4.439 
1.468 

2. J')l 
25.091 

0.H91 
1.122 
13.572 
2.928 

3. tm 

0.»)2 3 
1.701! 
0.901 



0.4«6 
0.794 
0.470 
5.<H3 
5.5U2 
0.530 
2.001 
2.500 
0.752 
2.635 
0.492 
l.4'Ui 
0.H77 
0.636 
22.563 
0.311 
0.350 
0.563 
0.233 
0.556 
0.26.6 
0.627 ' 
0.391 



0.366 
2.440 
0.583 

39.045 
ft. 630 
3.5i5 
2.12B 
L.360 
0.466 

11.107 
0.593 
4.bl2 
1.522 
2.343 

25.244 
0.903 
1.164 

13.573 
2.904 
3.022 
0.918 
1.691 
0.779 



0.300 
2. 700 
0.634 

41.625 
9.500 
3.639 
1.865 
1.152 
0.522 

11.243 
0.506 
4.525 
1.432 
2.073 

23.416 
0.949 
1.112 

L3.549 
2.910 
3.087 
0.890 
1.410 
0.646 



0.462 
0.720 
0.482 
9.237 
5.025 
1.040 
3.4HI 
1.793 
0.827 
2.195 
0.5O0 
1.306 
0.902 
0.698 
22.245 
0.220 
0.334 
0.788 
0.326 
0.743 
0.3L3 
0.845 
0.478 



0.324 
2.039 
0.722 

41.563 
9.870 
3.509 
1 .876 
1.327 
0.565 

11. L 92 
0.500 
4.403 
L.378 
2.030 

23.262 
0.937 
1.070 

13.548 
2.933 
3.09b 
0.895 
1.427 
0.668 



0.089 
-0.525 
-0.290 
-0.34L 
-0.236 
0.045 
0.080 
0.015 
-0.125 
-0.035 
0.L86 
0.L53 
0.163 
0.469 
0.088 
-0.126 
0.274 
0.037 
-0.093 
-0.1IL 
0.078 
0.358 
0.253 



0.73 
-4.70** 
-2.69** 
-2.74** 
-L.86 

0.47 

0.64 

0.12 
-1.01 
-0.28 

1.47 

L.32 

1.30 

3.85** 

0.72 
-1. 01 

2.24* 

o.r: 

-0.75 
-0.90 
0.62 

2.05* 



■UVn t/AUAULE CODfiU AS FOLL'lH'j : 

) * IIE'/LK WKEfl FOLL TJVE UR PART TIME SINCE LEAVING THE PROGRAM, ANO NOT GOING TO SCHOOL 

I - mVllldSlY WiU'KliD FULL TIME. (IP wURKLH PART TIM* S I MCE LEAVING THE PROGRAM, OR GOING TO SCHOOL PART TIME 

! = m, *..XKlNu lOLL TIME, OR GOING TO SCHOOL HULL TIME, „DR DOING ROTH PARI TIME 

fJlitf OF ACTIVITY STATUS (LM 

; * \til FULL TME POSITIVE ACTIVITY MOW I 'SAME AS 0 f 1 ABOVE) 
» FULL TIME POSITIVE ACTIVITY ISAMF \$ 2 ABOVE) 
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Appendix X-4 



WOMEN'S JKIP&AU 

IS I* UWAklWE ADJU51E0 CFFKCTS FOR PARTICIPANT AND CONTROL GROUP COMPARISONS ON 3-MONTH FOLLOW-UP 

WITH ADJUSTMENTS FOR BIAS 

EMIIUPA&IIS CONIBOLS 



s.o. 



ADJ. 
MEAN 



MFAN 



S.O. 



ADJ. 
MFAN 



COVARIANCE 
AOJtJSTEO 
EFFECT 



uur? 

DUALITY (0>Lliki I'HfCHI 
<S WUK'j Pt» UFFK? 
UK WdrKS ON JUti? 
Kit WA5F? 

APPLICATIONS TOR JOliS? 
»FR Or 1'lTCkVIEWS? 
Jci: OF KAISES? 
■ NSS 'VP.WT J,)*? 

IN SCHC.oL iM V GAINING? 
'.Y ( ;D: nIi.iir'iT PAY tXPCCTtl? 
.i'lYLIi: SU MHFM PLANVJ 
4ICH OU *OU K»U* A ROUT JOB? 
*>Jt.H :>U YOU JIVF YOUR FAMILY? 
UFTCH JO YiJJ SAVE? 

IS SlVpi.; Y?iU A HAkl) F IMF? 
IMAtlT TU KGLP njT 01 Tl.nu*LE? 

I;.*' Jin mi?? 

Iflte JOM J'MLITY (0»LOK, UiHGH 

VI TV STATUS It) 

VIJY SUTUS (2) IKFCOMCOI 



0.156 
2.2R* 
0.V29 
37.400 

3.310 
2.571 
1.313 
J. 545 
10.94H 

0. 'iU 
1.908 

1. bW 
2.i70 

10.797 
0.071 
1.126 

13.275 
2.978 
3.013 
O.BRO 
1.400 
O.Sf>7 



0.362 
0.79S 
0.495 
4.005 
3.445 

0. 575 
2.7^6 

1. 174 
0.656 
2.086 

0. V37 

1. ^o 
0. 7*2 
0.576 

I6.«5h 
0.16b 
0.332 
0.tll3 
0.14R 
0.643 
0.325 
0.757 
0.496 



0.226 
2.199 
0.483 
36.619 
10.36B 
3.3A0 
3.179 
1.417 
0.621 
10.421 
0.729 
3. 932 

i.7e2 

2.421 
10.450 
0.9*2 
1.154 
13.346 
2.970 
3.074 
0.900 
1.692 
0.757 



0. 222 

1. R75 
0.357 

35.429 

14.296 
3 . 000 
6.125 
2.250 
0.333 

10.000 
0.441 
3.400 
1.556 
2.333 
a. 958 
1. 000 
1.0*6 

13.389 
2.912 
2.742 
0.677 
1.333 
0.503 



416 
599 
479 
371 
776 
661 
5.908 
2.046 
0.471 
1.871 
0.497 
0.655 
0.831 
0.596 
20.915 
0.0 
0.280 
0.678 
0.264 
0.670 
0.467 
0. 850 
0.493 



0.152 
1.962 
0.302 

36.210 

13.281 
2.922 
5.517 
2.166 
0.258 

10.527 
0.324 
3.276 
1.421 
2.283 
9.295 
0.93? 
1.05* 

13.316 
2.919 
2.682 
0.657 
1.041 
0.393 



0.191 
0.341 
0.372 
0.098 



-0.570 
0.750 

-0.532 

-0.438 
0.644 

-0.054 
0.523 
0.613 
0.453 
0.234 
0.061 

-0.086 
0.314 
0.044 
0.234 
0.597 
0.614 
0.810 
0.735 



0.69 

9.38** 

1.41 

0.64 
-5.83** 

3.14** 
-2.61** 
-2.03* 

3.72** 
-0.14 

3.05** 

1.73 

1.95 

0.85 

0.24 
-0.19 

1.08 

0.14 

0.96 

2.16* 

2.36* 

3.37** 

2.97** 



00 



IVEO VA.MAHF CO c 'i AS KiLLUWS: 

= iSSn^u C ','K^ T uu n^!r U ;! F ^ NCL LE J VING THF PR0CRAH ' m) N0T « SCHOOL 

Mu Ur ACTIVITY STATUS (lit 

« fir IULI Tl*F POSITlVf ACTIVITY ,'JUW (SAME AS 0 ♦ I A&OVEl 
= FULL THE POSITIVE ACTIVITY ( SAMt AS 2 tnilVE) 
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Appendix X-5 



NATIONAL COUNCIL OF NFGRO WOMEN 
SI > UF CiiVAHMCC APJUSUn OFTPCTS FUR PARTICIPANT AND CONTROL GROUP COMPARISONS ON 3-MONTH FOLLOW-UP 

WITH ADJUSTMENTS FOR BIAS 

CQtllfiQLS 



ADJ. 

Ml: AN S.D. MEAN MEAN S.D. MEAN 



COVARIANCE 
ADJ. AOJUSTED 

EFFECT T 



MfcHG F'JLL-TIME NOW? O.II3 0.316 0.133 0.2P6 

IP HUE? 2.571 0.'i04 7.673 2.214 

Jii QUALITY lD=l'Th, l = HljH) 0.571 0.4)«i 0.610 0.500 

I'JcS h'.^F;: PEfJ KEEK? 37.US 3.407 36.932 38.429 

JfHGU M r K3 v!N JUH? 6.000 4.637 5.986 8.200 

AKLY 1 A jE? 3.666 0.806 3.747 3.071 

MM* ALLIGATIONS f&P Jf.«S? 2.r25 2.497 2.389 1.750 

1 -!*4FH iT IriTlPVIEViS? Z.000 1.291 2.196 0.818 

WEk OF TAlStS? 0.125 0.J31 0.117 0.077 

"EL IMG S AbOUT jnc? lo.nis 2.208 11.362 I0.n25 

V> SCrluJL i)V TRAINING? 0.750 0.433 0.714 0.722 

lPUft.3 8 HI'jMCST PAY LXPLCTEO? 4.765 l. r >29 4.237 3.796 

•)?lUYrJ1 SIX HbNTH PLANS? I . f*00 O.dUO 1.485 1.68B 

Hi MUCH LM YOU KWPH ABtUT J HI? 2.453 0.636 2.460 2.515 

M MUCH HO YCU GIVL YOUR FANILY? IM.09 i 22.444 20.367 31.429 

!W UFThN IXi YbU SAVE? I. 000 0.0 I. 000 I. 000 

i luU fiUY »JM CREDIT? 1.015 0. 121 1.016 1.042 

H' IS olVlw; YOU A HARD THE? 13. 726 0.530 13.699 13.328 

'F'jKTAM T'.l KEEP CUT OF TkUUPLE? 2.9!>8 0.201 2.971 3.000 

)TU:*F JU» TITLE? 2.9*4 0.7S6 3.008 3.000 

JTJXf JOl O'JALITY 10=LUWi l-HIGH 0.778 0.4U) 0.004 0.839 

;ilVMY STATUS (I) 1. 722 0.629 1.712 1.7?? 

;T 1 V 1 TY STATUS (2) ISECODlD) 0.U9 0.3t!5 0.303 0.U21 



0.452 
0.860 
0.500 
2.921 
3.6S5 
0.317 
2.165 
1.029 
0.266 
1.943 
0.448 
0.963 
0.583 
0.702 



20.392 
0.0 
0.200 
0.378 
0.0 
0.568 
0.366 
0.612 
0.383 



0.265 
2.1U 
0.462 

33.622 
8.214 
2.990 
1.986 
0.622 
0.084 

10.282 
0.758 
3.825 
1.602 
2.503 

30.152 
1. 000 
1.040 

13.855 
2.987 
2.936 
0.812 
1.742 
0.838 



-0.345 
0.635 
0.297 
-0.534 
-0.538 
1.3V) 
0.173 
1.357 
O.IU 
0.520 
-0,100 
0.331 
-0.458 
-0.072 
-0.4.57 
0.0 
-0.149 
-0.344 
-0.164 
0.109 
-0.021 
-0.048 
-0.093 



-1.64 

4.04** 

1.49 

1.49 
-2.96** 
-2.96** 
-2.96** 
13.40** 

0.69 

3.78** 
-0.56 

4.91** 
-3.42** 
-0.29 
-2.07* 
-2.07* 
-0.80 
-1.60 
-0.51 

0.48 
-0.07 
-0.24 
-0.44 



JF-UVlO VARIABLE CUUFO AS FOLLOWS: 

U = uEVFR W'JftKtD FULL THE 'IR PART THE SINCE LEAVING THE PROGRAM, A NO NOT GOING 10 SCHOOL 

I = frY.FVlUUSLV MXKFD FULL Tl M E, DK vjORKEO PART T IMF SINCE LEAVING THE PROGRAM, OP. GOING TO SCHOOL PART TIME 

? = tm hO^KPIb FULL TIME, OH GONG TU SCHOOL FULL TIMEt OR OOING ROTH PART TIME 

:OM?l"i »F ACTIVITY STATUS <l>: 

0 = FULL IMC POSITIVE ACTIVITY tlV/A I SAME AS 0 ♦ I ABOVE) 

1 = FULL TIME POSUIVE ACTIVITY (SAW AS 2 ABOVE) 
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Appendix X-6 



RCO'Ul IMLNT ANO TRAINING PROGRAMS 
'SIS Of CW»I«W ADJUST EFFECTS FPr. PARTICIPANT A NO CUNTRO,. GROUP COMPARISONS ON J-HUNTH FOLLOW-UP 

WITH ADJUSTMENTS FOR BIAS 

EAaiICIEA!IIS CIMEOLS 



B F i I Lf ? 

rt JUAllFY (J«LliHi l = iUG:U 
Jit5 nfiMU.u PC". MCHK7 
•'trlt*' l.l-t'KS ON JOH? 
UKLV AAtit? 

N3LR AmiUTHNS FOR JfJttS? 

iWE;« uf j?nf;RviciiS? 

Wrt (IF KMSFS? 

clmgs Ai":ur jim? 

fc in SCHDPL u* tpaI'iimg? 

PluYf-Hl HliiHPSf PAV i:xPfC!KO? 
PLliYli)! SU MMTH PLAfJS? 

* >;ULH Yd J KNtlh AM,)UT J(l"? 

» M UCi| OH YPij GIVE YUUK FAMILY 7 

* 'TFLII |)i i Y(»U SAW? 
YuL) I-IIY uil CKEDIT? 

t IS lilVlNj YiiU A MAIU1 MM*? 

■MRTAfir rr- keep uut nr trim ley 

' UP L JO!! MTU? 

:ji.f juft f -jAL r rv lonnw, i=hh;h 

f V 1 1 Y STATUS IM 

IVI1Y STATUS (2) WXlJJfD) 



ML AM 



o. mi? 

7.303 
O.M4 

11.0)6 

4. 424 
1.719 
0,500 

1:1.422 
3.5A6 
4.407 
1.740 
2.201 

I ^ . d 7 7 
0.953 
1.085 

11.3B3 
2.S57 
2.34? 
0.<>9? 
1.497 
0.A51 



S.D. 



0.136 
1.029 
0.'W3 
3.131 
5.949 
0.590 
4.7*93 
2.035 
0.7^4 
2.240 
0.492 
1.281 
0.65rt 
0.655 
it.6d4 
0.212 
0.279 
0.502 
U.2t)4 
0.734 
0.4«i9 
0.749 
0.476 



ADJ. 
MEAN 



0.185 
2.247 
U. 399 

3H.449 

11.234 
3. 264 
4.524 
1.374 
0.409 

10.352 
0.627 
4. 'tlH 
1.749 
2.254 

10.949 
0.955 
1.084 

13. 384 
2.967 
2.875 

0.724 
1.55H 

0.690 



MEAN 



0.147 
2. 120 

0. 3<;2 
40.455 

3.089 
3.354 

1. f>57 
1.190 
0.435 

10.990 
0. 640 
4.419 
1.471 
2.0H1 

10.2TB 
0.097 
1 .049 

13.415 
2.944 
2.H38 
0.699 
1.570 
0.714 



S.D. 



0.354 
0.916 
0.480 
7.303 
5.301 
0.626 
2.913 
1.096 
0.64!) 



492 
'♦90 
416 
ft4H 
619 



16.844 
0.305 
0.243 
0.552 
0.229 
0.815 
0.459 
0.7L7 
0.452 



AOJ. 
MEAN 



0. 144 
2.176 
0.376 

40.695 
B.691 
3.370 
3.553 
i.035 
0.445 

11.060 
0.600 
4.409 
1.462 
2.028 

12.206 
0.694 
1.050 

13.413 
2.934 
2.806 
0.664 
1.517 

0.676 



COVARIANCE 
AOJUSTCO 
EFFECT 



0.113 
0.077 
0.047 

-0.430 
0.452 

-0.174 
0.252 
0.536 
0.062 

-0.299 
0.055 
0.004 
0.3B1 
0.355 

-0.071 
0.235 
0.133 

-0.051 
0.149 
0.089 
0.153 
0.056 
0.029 



1.02 

0.70 

0.44 
-3.73** 

4.20** 
-2.25* 

2. BR** 

4.55** 

0.55 
-2.74** 

0.50 

0.06 

3.60** 

3.24** 
-0.64 

2.12* 

1.18 
-0.46 

1.33 

0.79 

1.40 

0.52 

0.27 



03 
O 



RlVtD VIABLE COOED AS FOLLOWS: 

: KmS^K riu n.^Vlm^rpl^^^Illc/^"^; J" m GOING TO SCHOOL 

■ <r, WM T, full wi\ o! chinS ^WXSWSJi?,;?, KB R }Se°" 60,MG T ° SCH00L PART t,HE 

tfINU (T ACTIVITY STATUS (1): 

• w j mi Tinr positive activity now isamf as o ♦ i above) 

* FOIL TINI positive ACTIVITY (SAME AS 2 AHUVE) 



u 
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Appendix X- 7 



ALL PROGRAMS COrtRlNEO 

( 1S UP CUVAR1 ANCEJ ADJUSTED f FTECTS FOR PARTICIPANT AMD CONTROL GROUP COMPARISONS ON 3-MONTH FOLLOW-UP 

WITH ADJUSTMENTS FOR BIAS 

EALIIUEmS CQUIR2LS 



MCAN 



S.D. 



ADJ. 

MCAN 



MFAN 



S.D. 



AOJ. 
MEAN 



CnVARUNCE 
ADJUSTED 
EFFECT T 



r;l\j Filll-imC- NOW? 0.246 0.430 0.257 0.251 0.4*4 0.240 0.038 0.70 

> TITLf? 2.368 0.362 2.306 ?.259 0.092 2.261 0.143 2.75** 

\ VJALlTY 10*LMi l«HI'tHI 0.«U0 0.500 0.511 {?,456. 0.498 0.455 0.111 2.13* 

ir!S MllUM »K* ..l : CK? 3s.3bO 6.039 39.407 40.316 7.268 40.269 -0.130 -2.40* 

lii viLIKS ON JHh? 9.31* 5.616 9.472 9.310 5.608 't. 163 0.056 1.03 

irLV KAC.t? 3. >37 0.675 3.394 3.471 0.944 3.414 -0.024 -0.55 

1:)FP. APPLICATUNS FUR JU»?S? 2.873 3.646 2.913 2. 561 3.471 2.521 0.1 10 2.01* 

WCR ur liJTntVUnS? 1.497 il.017 1.488 1.225 1.486 1.234 0.U5 2.54* 

ItlU ur KA1SES? 0.'i47 0.738 0.462 0.4*7 0.750 0.442 0.027 0.48 

ILIMS ABOUT Jrt-37 IC.394 2.373 10.933 11.048 2.254 11.009 -0.033 -0.60 

i IN SCli f J\ OK TP AIMING? 0.565 0.496 0.5t)6 0.565 0.496 0.564 0.006 0.10 

>LUY!:tf: If I^IICST ?\i rxPf-CTE'.)? 4.21b 1.532 4.2eL 4.311 1.417 4.247 0.023 0.44 

!t!V£u: SIX WIH PLANS? . 1.596 0.7'A 1.579 1.495 0.846 1.512 0.081 L.48 

i MUCH Oli Y'W KNtiW APOUT JlB? 2.335 0.642 2.347 2.199 0.676 2.1H7 0.242 4.43** 

s MUCH OLi YOU 61 VF YlHJR FAMILY? 19.322 22.084 19. 197 20.161 22.513 20.486 -0.058 -1.09 

I UFTtN He YniU SAVF? fc 0.946 0.226 0.951 0.935 0.247 0.929 0.093 1.67 

YOU 'tUY OM CHL Dll? 1. 123 0.343 1.131 1.090 0.285 1.073 0. 186 3.36** 

J IS UIVI'JG YUU A HARD T IMF ? 13.427 0.720 13.441 13.510 0.70 r # 13.486 -0.064 -1.16 

'liiiTAMT To KFtP OUT UF TRUUliLE? 2.939 0.245 2.939 2.930 0.26B 2.931 0.033 0.60 

nm joi; iiur? 2.953 0.713 2.900 2.927 0.769 2.919 0.056 1.01 

IUkL Jin QUALITY Iu=L0W, 1*HIGH 0.810 0.386 0.823 0.784 0.411 0.780 0.107 1.95 

[1V1TY STATUS M) l. r »09 0.740 1.527 1.524 0.750 1.507 0.027 0.49 

f IV 1 TV STATUS (2) (RFC'JOED) 0.1»59 0.474 0.671 0.6H1 0.466 0.669 0.005 0.09 



00 
H 



i-WVhO VARIABLE COUfcD AS FOLLOWS: 

) = NCVLK WClKKEi) FULL TIKE OR PAkT THE SINCE LEAVING THE PROGRAM^ AND NOT GOING TO SCHOOL 

I = "KFVIU'JSLY WORK ID FULL THh, OP KURK^O tf ART TIME SINCE LEAVING THE PROGRAM. OR GOING TO SCHOOL PART TIME 

I - HUK ViOHKlNG HULL 1IME. OR GOING TO SCHOOL FULL T I MEt OR DOING BOTH PART TIME 

;!)UG OF AClIvlTY STATUS (1): 

) = r iU rULL TIME POSITIVE ACTIV1IY NOW (SA1F AS 0 f I ABOVE) 
I * rULL T I ME POSITIVE ACTIVITY I SAME AS 2 ASOVE) 
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